REPORT  DOCUMENTATION  PAGE _  o^TNaoyTom 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  f^  reviewing  instoictions,  searching  existing  data  sources,  gathering  and  maintaining 
me  data  need^  and  completing  and  reviewing  this  collection  of  information.  Send  comments  regarding  this^urden  est.#.ate  or  any  other  aspect  of  this  collection  of  Information,  including  suggestions  for 
r^ucing  this  burden  to  Washington  Headquarters  Services.  Directorate  for  Information  Operations  and  Rep^s,  1215  Jefferson  Davis  Highway.  Suite  1204.  Arlington,  VA  22202^302  and  to  the  Office  of 


Management  and  Budget,  Paperoork  Reduction  Project  (0704.0188),  Washinqlon  DC  20503 

1.  AGENCY  USE  ONLY  (Leave  I  2.  REPORT  DATE 

b'ank)  _ ^ _  12/18/01 _ 

4.  TITLE  AND  SUBTITLE 

Interferometric  Digital  Imaging 


3.  REPORT  TYPE  AND  DATES  COVERED 

Final,  -g/-l/90  2/1/01-  Qi  <bl 

5.  FUNDING  NUMBERS 

ARO  Contract  38310-PH 
DAAG55-98-1-0039 


6.  AUTHOR(S) 

David  J.  Brady,  David  C.  Munson  and  Eric  Michielssen 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 
Beckman  Institute 

University  of  Illinois  i 

405  N.  Mathews  / 

Urbana,  IL  61801  I 


m 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


-  -  -  fCJ/  / 

9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(E^ 

Dr.  David  Skatrud 

U.  S.  Army  Research  Office 

P.O.Box  12211 

Research  Triangle  Park,  NC  27709-2211 
11.  SUPPLEMENTARY  NOTES  ~ 


10.  SPONSORING  /  MONITORING 
AGENCY  REPORT  NUMBER 


3S510.4.-  Pl+ 


12a.  DISTRIBUTION  /  AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 


12b.  DISTRIBUTION  CODE 


I  13.  ABSTRACT  (Maximum  200  Words)  ~ 

The  Illinois  Interferometric  Imaging  Initiative  (4 Is)  demonstrated  that  aspects  of 
conventional  focal  imaging,  coherence  sensing,  holography,  spectroscopy  and  tomography 
could  be  integrated  to  obtain  revolutionary  new  functionalities  in  digital  imaging 
systems.  Novel  functions  demonstrated  included  multidimensional  imaging,  phase  and 
polarization  sensitive  imaging,  simultaneous  spatial  and  spectral  analysis  and  nonlocal 
basis  vector  sampling.  The  4 Is  initiative  provides  strong  evidence  that  the  "pixels-to- 
pupils  ratio"  problem  of  distributed  sensor  systems  can  be  addressed  by  designing  sensors 
to  detect  target  specific  physical  primitives.  These  primitives  can  be  adaptively  or 
interactively  identified  and  isolated-  Initiatives  to  develop  scan-free  3D  microscopes, 
spatio— spectral  biosensors,  advanced  tracking  telescopes  and  cooperative  sensor  arrays 
have  resulted  from  the  4Is  initiative. 


4  14.  SUBJECT  TERMS 


15.  NUMBER  OF  PAGES 

L.•^V^D\^L 

1$.  PRICE  CODE 


17.  SECURITY  CLASSIFICATION  I  18.  SECURITY  CLASSIFICATION  I  19.  SECURITY  CLASSIFICATION  20.  LIMITATION  OF  ABSTRACT 
OF  REPORT  OF  THIS  PAGE  OF  ABSTRACT 

unclassified  unclassified  unclassified 

NSN  7540-01-280-5500  Standard  Form  298  (Rev.  2-89) 

Prescribed  by  ANSI  Std.  Z39<18 
298‘102 


20020125  279 


Fitzpatrick  Center  for  Photonics  and  Communications  Systems 

Duke  University 


Table  of  Contents 


PROGRAM  OVERVIEW 


3 


RESEARCH  RESULTS 


5 


The  Sensor  Problem . 

Sampling  Field  Sensors . 

Rotational  Shear  Interferometers . 

Astigmatic  Coherence  Sensors . 

Tomographic  Analysis  of  Optical  Images 

Efficient  Source  State  Estimation . 

Limits  of  Multiplex  Imaging . 


.5 

.6 

.7 

.9 

.9 

10 

11 


OPPORTUNITIES 


12 


PERSONNEL . . . 13 

PUBLICATIONS . 1 . 13 

APPENDIX:  PUBLICATION  REPRINTS . 16 


Publications  on  Sampling  Field  Sensors . . . 17 

Rotational  Shear  Interferometers . 59 

Astigmatic  Coherence  Sensors . 1 26 

Tomographic  Analysis  of  Optical  Images . j  52 

Efficient  Source  State  Estimation . 1 79 

Limits  of  Multiplex  Imaging . 206 


2 


Program  Overview 

“Interferometric  Digital  Imaging,”  a  DARPA  DSO  ACMP  program  funded  under  ARO 
management  as  ARO  Contract  38310-PH  DAAG55-98-1-0039  examined  the 
fundamental  limits  of  information  transfer  through  optical  apertures.  Conventional 
imaging  systems  perform  both  a  data  acquisition  and  a  data  processing  role.  The 
interferometric  digital  imaging  program  focused  on  the  question:  “Can  the  data 
acquisition  rate  of  an  aperture  be  increased  by  changing  or  reducing  the  conventional  data 
processing  role?”  Three  years  of  investigation  have  shown  that  there  exist  interesting  and 
technologically  important  situations  in  which  the  answer  to  this  question  is  yes. 

This  project  exposed  opportunities  for  mixed-mode  optical  and  opto-electronic 
processing,  ad  hoc  networking  and  aggressive  digital  processing  on  optical  and  infrared 
imaging  systems.  The  project  demonstrated  near-term  opportunities,  including: 

•  The  use  of  the  sampling  field  sensor  (SFS)  for  process  control  and  materials 
characterization  in  optical  and  electronic  manufacturing, 

•  The  use  of  the  SFS  in  multi-wavelength  mode  for  ranging  and  3D  imaging, 

•  The  use  of  the  SFS  for  wavefront  characterization, 

•  The  use  of  the  rotational  shear  interferometer  for  3D  microscopy  and  the  potential 
for  scan-free  interferometric  3D  microscopy, 

•  The  use  of  rotational  shear  interferometers  for  high  speed  spatio-spectral  tracking, 

•  The  potential  for  direct  physical  measurement  of  source  projections  on  nonlocal 
bases, 

•  The  potential  use  extended  depth-of-field  interferometer  arrays  for  spatio-spectral 
aerosol  analysis, 

•  The  use  of  coherence  mode  decomposition  for  distortion  correction  and  imaging 
through  turbulence, 

•  The  potential  for  global  transformations,  rather  than  correlation  interferometery, 
for  background-free  coherence  characterization. 

•  The  potential  use  of  extended  depth  of  field  interferometric  sensors  for  multiple 
access  free  space  optical  communications. 

These  opportunities  suggest  that  digital  interferometery  will  produce  significant  changes 
in  optical  and  infrared  imaging  systems  over  the  full  range  from  microscopy  to  telescopy. 

Conventionally  the  data  processing  role  of  an  imaging  system  is  to  form  a  physical 
isomorphism  between  a  source  space  and  a  measurement  space.  For  example,  a  pixel  on  a 
camera  focal  plane  corresponds  to  the  field  on  a  source  plane.  Imaging  systems  that  do 
not  form  such  isomorphisms  use  inversion  algorithms  to  estimate  source  state  parameters 
from  measurements  that  depend  nonlocally  on  the  source  state.  We  refer  to  these  systems 
as  multiplex  imagers.  The  primary  advantage  of  multiplexing  is  the  freedom  it  gives  the 
designer  to  incorporate  global  system  performance  measures  into  system  design.  There  is 
only  one  isomorphic  transformation  between  the  source  state  and  the  measurement  space, 
there  are  infinitely  many  multiplex  transformations.  Multiplex  system  design  consists  of 
choosing  the  transformation  that  achieves  the  best  rate  and  accuracy  of  source  parameter 
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estimation  within  physical  and  deployment  constraints.  Because  the  multiplex  design 
methodology  combines  physical  constraints  and  logical  analysis  goals  the  ACMP 
community  has  adopted  the  phrase  “integrated  sensing  and  processing”  (ISP)  to  describe 
it.  If  we  were  to  start  again  in  1998,  “Integrated  sensing  and  processing  in  multiplex 
digital  imaging”  would  be  the  best  name  for  the  program  reported  here. 

Inteferometric  Digital  Imaging  was  the  core  project  of  the  Illinois  Interferometric 
Imaging  Initiative  (4Is).  4Is  began  with  an  exploration  in  the  summer  of  1995  into  the 
possibility  of  lensless  imaging  by  sampling  and  digital  processing.  This  exploration  led  to 
the  development  of  the  sampling  field  sensor  in  1996.  Development  of  the  sampling  field 
sensor  was  initially  supported  by  the  University  of  Illinois  and  the  Packard  Foundation. 
Following  the  construction  of  an  initial  prototype  the  SFS  project  was  described  to  Drs. 
L.  N.  Durvasula  and  Dennis  Healy  in  the  summer  of  1997,  which  led  to  the  start  of 
DARPA  support  in  February  1998.  In  this  report,  “this  program,”  “Interferometric 
Digital  Imaging  program,”  and  “4Is”  are  treated  as  synonymous. 

Initial  work  on  rotational  shear  interferometers  had  already  started  by  the  beginning  of 
the  DARPA  program  and  it  was  already  clear  to  the  4Is  team  that  the  most  significant 
results  of  this  program  would  be  the  delineation  of  processing  and  sensing  capabilities  in 
multiplex  systems  rather  than  the  details  of  specific  demonstrations.  A  high  priority  was 
placed  on  demonstrations,  however,  as  existence  proofs  of  the  fact  that  new 
functionalities  would  emerge  from  unconventional  imagers. 

4Is  directly  spawned  four  successors:  the  Duke  Integrated  Sensing  and  Processing  group 
(DISP),  the  DISP  Information  Spaces  Project  (also  DISP),  Distant  Focus  Corporation  and 
Phase  Optics,  Incorporated.  The  integrated  sensing  and  processing  group  includes  two 
DARPA  supported  initiatives,  one  funded  under  the  ACMP/DSO  program  and  managed 
through  ARO  in  computational  microscopy  for  scan-free  3D  imaging  and  projection  on 
nonlocal  bases  and  one  in  under  the  PWASSP/MTO  program  and  managed  through 
AFOSR.  The  information  spaces  project  has  been  supported  by  AFOSR  and  through 
substantial  direct  investments  from  Duke  University  and  the  University  of  Illinois. 
Distant  Focus  Corporation  completed  a  DARPA  funded  tomographic  ground  sensor 
project  under  subcontract  to  the  University  of  Illinois  and  is  currently  developing  a 
wireless  sensing  and  processing  platform  for  heterogeneous  multiplex  infrared  tracking 
and  target  recognition.  Distant  Focus  is  working  with  Raytheon  West  on  applications  of 
this  technology  to  flying  object  identification  and  tracking.  For  more  information,  see 
www.distantfocus.com  Phase  Optics  licensed  sampling  field  sensor  technology  from  the 
University  of  Illinois  and  received  seed  financing  for  commercializing  this  product  in  the 
context  of  semiconductor  manufacturing  process  control.  See  www.phaseoptics.com  for 
more  information. 

We  report  here  (1)  research  results  from  optical  systems,  system  capability  analyses,  data 
analysis  algorithms  and  methodologies,  (2)  technology  transfer  results  aimed  at 
introducing  the  results  of  this  program  in  deployable  systems,  (3)  opportunities  for 
further  development  exposed  by  this  program  and  (4)  personnel  and  publications 
resulting  from  this  program 


4 


Research  Results 

The  Sensor  Problem 

The  Illinois  Interferometric  Imaging  Initiative  (4Is)  focused  on  information  transfer  on 
optical  fields.  The  process  of  information  transfer  on  radiating  fields  consists  of 

1 .  data  encoding  in  a  source  state, 

2.  coupling  from  the  source  state  to  the  field, 

3.  propagation  of  the  field, 

4.  modulation  of  the  field, 

5.  detection  of  the  field  and 

6.  estimation  of  the  source  state  from  the  detected  field. 

Steps  1-3  may  be  considered  as  a  physical  layer  beyond  the  reach  of  sensor  designers. 
(Perturbation  of  this  layer  changes  the  source  state).  The  sensor  problem  consists  of  the 
design  of  steps  4-6  to  maximize  measures  of  system  performance.  4Is  considered  whether 
or  not  radical  new  approaches  to  steps  4-6  might  be  taken  in  optical  systems. 

For  example,  coherent  scalar  radiation  from  a  transparent  source  in  a  homogeneous  space 
is  described  by  a  superposition  of  Huygens  wavelets  or,  more  generally,  by  a  linear 
transformation  of  the  form 


where  /(r)  is  the  primary  source  density,  g(r')  is  the  radiated  field  and  /?(r,r')  is  the 
impulse  response.  /  (r)  is  the  source  state.  Eqn.  (1)  expresses  the  process  of  information 
transfer  through  step  3. 

The  conventional  goal  of  optical  system  design  is  to  develop  optics  capable  of  inverting 
Eqn.  (1).  One  places  components  in  the  propagation  space  of  the  field  to  implement  a 
transformation  ^(r^r")  on  g(r').  The  transformed  field  is 

g(r')=  Jg(r')^(r',r'')t/V  (2) 

In  the  ideal  conventional  system,  ^h{r,r')h[r' ,r'')d^r'  =  d[r -r”) ,  in  which  case  the 
measured  transformed  field  is  isomorphic  to  the  source  state. 

4Is  challenged  the  implicit  and  explicit  assumptions  of  conventional  sensor  design.  These 
assumptions  include: 

1 .  The  possibility  of  isomorphic  transformations.  The  class  of  sources  that  can  be 
isomorphically  mapped  by  physical  transformation  from  the  source  state  to  the 
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sensor  state  is  a  small  subset  of  the  class  of  all  possible  source  states.  In  general, 
only  two  dimensional  monochromatic  sources  can  be  isomorphically  mapped. 

2.  The  desirability  of  isomorphic  transformations.  Even  in  cases  where  isomorphic 
transformation  is  possible,  such  transformations  do  not  achieve  the  best  system 
performance  against  all  performance  metrics. 

3.  The  nature  of  source  coding  and  inversion.  One  may  often  be  interested  in 
distributed  properties  of  sources,  “As  in  how  red  is  the  source.”  Abstraction  from 
locally  isomorphic  maps  may  not  be  efficient  in  estimation  of  these  generalized 
source  states. 

4.  The  nature  of  fields  and  media.  In  optical  systems  the  coherent  electro-magnetic 
field  is  generally  not  directly  measureable.  The  intensity  field  is  measurable,  but 
is  not  necessarily  fully  descriptive  of  the  source  state.  Dimensionality  and  field 
transformations  play  critical  roles  in  analysis  of  the  field  states.  The  change  in 
dimensionality  from  Eqn.  (1)  to  Eqn.  (2)  reflects  the  fact  that  sources  are 
generally  three  dimensional  while  coherent  fields  are  fully  characterized  from  2D 
boundary  conditions.  More  general  field  models  are  needed  to  describe  the 
relationship  between  general  source  states  and  radiated  fields. 

4Is  examined  these  assumptions  by 

1 .  Exploring  the  limits  of  direct  sampling  of  the  electro-magnetic  field.  If  the  field 
could  be  directly  measured,  all  possible  transformations  and  information  from  the 
field  could  be  obtained  by  digital  processing.  4Is  used  the  sampling  field  sensor 
to  directly  measure  coherent  fields. 

2.  Exploring  the  limits  of  direct  sampling  of  coherence  fields.  In  most  optical 
systems  the  electro-magnetic  field  is  not  measureable.  The  radiation  field  is  fully 
and  fundamentally  characterized  by  coherence  measures.  4Is  used  the  rotational 
shear  interferometer  and  the  astigmatic  coherence  sensor  to  directly  characterize 
the  coherence  field,  which  then  could  be  digitally  processed  to  estimate  the 
source  state. 

3.  Exploring  integration  of  physical  and  tomographic  inversion  of  radiation 
measures.  4Is  developed  novel  algorithms  and  applied  existing  algorithms  to 
novel  situations  to  show  that  analog  and  digital  processing  could  be  integrated  to 
analyze  multidimensional  sources. 

4.  Exploring  nonlocal  transformations  for  efficient  source  state  estimation. 

5.  Exploring  the  physical  limits  of  multiplexing. 

Results  from  these  investigations  are  briefly  summarized  in  the  following  sections.  In 
each  case,  substantially  more  detailed  discussions  are  included  as  attachments  in  the 
Appendix.  Our  goal  here  is  to  state  as  simply  and  briefly  as  possible  the  significance  of 
each  component. 

Sampling  Field  Sensors 

As  discussed  in  detail  in  the  documents  included  in  the  appendix,  the  sampling  field 
sensor  (SFS)  is  a  wavefront  sensor.  Wavefront  sensors,  such  as  the  Shack-Hartman, 
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shearing  interferometer  and  phase  diversity  interferometer,  are  used  to  measure  weak 
wavefront  distortions  for  adaptive  optical  systems.  The  goal  is  to  build  systems  to 
conventional  isomorphic  maps  by  sensing  and  correcting  distortions.  At  the  level  of 
strongly  inhomogeneous  wavefronts,  holograms  may  also  be  considered  as  wavefront 
sensors.  The  goal  of  the  SFS  is  to  digitally  sense  wavefronts  as  complex  as  those  sensed 
by  holographic  systems.  The  SFS  may  be  considered  as  a  self-referencing  electronic 
hologram. 

The  SFS  uses  interference  between  multiple  samples  of  a  wavefront  to  estimate  the  phase 
and  amplitude  of  the  wavefront.  One  assumes  that  the  wavefront  can  be  sampled  at 
Nyquist  determined  frequencies  or  better  and  that  fan-out  to  interfere  samples  can  be 
implemented.  The  SFS  uses  local  differential  fan-out,  although  there  global  fan-out  may 
be  desirable  for  robust  wavefront  estimation. 

When  the  4Is  program  was  launched  a  preliminaiy  design  and  test  of  the  SFS  had  been 
completed.  During  the  early  stages  of  the  4Is  program  extensive  finite  element 
electromagnetic  evaluation  of  diffractive  SFS  fan-out  systems  showed  that  cross-talk 
would  be  a  serious  issue  in  all  purely  diffractive  systems.  In  response  to  this  difficulty, 
we  designed  birefringent  sampling  and  fan-out  systems  that  dramatically  reduced  cross¬ 
talk.  The  SFS  has  demonstrated  extremely  competitive  phase  estimation  capabilities,  as 
described  in  the  appendix. 

Several  promising  extensions  to  SFS  systems  have  yet  to  be  explored.  Most  interesting, 
preliminary  analysis  indicates  that  SFS  sensors  could  obtain  substantial  range  resolution 
by  sequential  multi-color  wavefront  sensing.  Effectively,  one  would  form  an  electronic 
hologram  of  a  scene  at  multiple  colors.  Assuming  that  the  spectral  dependence  of  the 
scene  is  weak,  the  3D  structure,  including  range,  of  the  scene  could  be  abstracted  from 
the  sequence  of  wavefronts.  Birefringent  SFS  systems  are  also  capable  of  estimating 
polarization  images  of  scenes,  which  can  be  used  as  physical  primitives  in  source 
analysis. 

The  University  of  Illinois  has  a  patent  pending  on  birefringent  SFS  technology.  This 
patent  has  been  licensed  to  Phase  Optics,  inc.,  which  is  pursuing  commercialization  based 
on  semiconductor  fabrication  process  control. 

Rotational  Shear  Interferometers 

The  assumed  association  between  the  source  state  and  the  radiation  field  is  one  of  the 
deepest  challenges  of  optical  sensing.  The  assumption  that  the  source  is  linearly  related  to 
the  coherent  field  is  may  be  accurate  for  coherently  illuminated  sources,  but  is  not 
otherwise  satisfactory.  Many  potential  relationships  exist  between  the  source  and  the 
radiation  state.  The  simplest  assiunption  for  self-luminous  and  ambiently  illuminated 
sources  is  to  a  linear  relationship  between  the  source  state  and  a  coherence  field.  This 
relationship  takes  the  form 

g(r',r'')=  j/(r)/2*(r,r'')/7(r,r')i/V  (3) 
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/j^r,r')  is  the  coherent  impulse  response.  Eqn.  (3)  is  obtained  from  Eqn.  (1)  by  assuming 

that  the  source  is  an  incoherent  radiator.  In  the  context  of  optical  coherence  theory  Eqn. 
(3)  is  called  the  Hopkins  integral. 

Like  the  field  itself,  g(r',r")  is  not  directly  measureable.  It  is  possible,  however,  to 

design  interferometers  that  measure  easily  invertible  functions  of  g(r',r'') .  The  simplest 

cases  are  two-point  correlators,  which  measure  samples  of  the  form 
g(r'.r')  +  g(r",r'')-i-g(r',r'')  +  g(r'',r').  More  complex  transformations  are  described 

below  in  the  ACS  section. 

Our  general  goal  in  sensor  system  design  is  to  place  objects  in  the  radiation  space  of  the 
field  such  that  data  in  the  field  is  revealed  on  propagation.  The  need  for  global 
transformations  on  propagation  is  the  most  significant  aspect  of  the  shift  from  field 
sensors  to  coherence  sensors.  In  the  case  of  the  SFS,  all  of  the  information  in  the  coherent 
field  can  be  obtained  from  local  sampling  and  low  bandwidth  differential  measurements 
are  sufficient  to  fully  characterize  the  field.  For  fields  characterized  by  coherence 
functions,  associations  between  fields  from  widely  separated  points  may  be  information 
bearing.  To  obtain  this  information  the  optica!  system  must  be  capable  of  interfering 
widely  separated  points  in  the  homogeneous  radiation  space. 

The  rotational  shear  interferometer  (RSI)  is  a  particularly  significant  testbed  for 
coherence  field  characterization  because  each  pixel  in  the  RSI  sensor  plane  measures 

g(r',r'')  for  a  unique  separation  Ar  =  r'  -  r' . 

41s  achieved  three  major  results  from  RSI-based  imaging  systems: 

1.  We  showed  analytically  and  experimentally  that  coherence  imaging  could  be 
applied  to  Fresnel  zone  and  three  dimensional  imaging.  To  our  knowledge,  the 
1999  Applied  Optics  mcmuscript  included  here  as  an  appendix,  was  the  first 
derivation  of  coordinate  systems  for  Fresnel  zone  analysis. 

2.  We  showed,  in  the  Science  paper  included  as  an  appendix,  that  infinite  depth  of 
field  coherence  images  could  be  combined  with  computed  tomography  to  capture 
3D  models  of  sources.  In  continuing  work,  we  believe  that  this  result  will  lead  to 
scan-free  3D  optical  microscopes. 

3.  We  showed  that  RSI-based  imagers  could  filter  out  projections  of 
multidimensional  source  data  cubes  without  first  capturing  isomorphic  data.  This 
result  is  described  theoretically  below  in  the  “efficient  source  state  estimation” 
section  and  experimentally  in  Jason  Gallicchio’s  Master  of  Science  dissertation, 
which  is  included  as  an  appendix. 
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Astigmatic  Coherence  Sensors 


While  full  characterization  of  the  field  radiated  by  an  incoherent  source  implies  full 
characterization  of  field  coherence  measures,  such  characterization  need  not  imply  direct 
measurement  of  the  coherence  functions  by  two-point  correlation.  As  part  of  the  4Is 
initiative,  we  developed  a  novel  coherence  sensor  based  on  transformations  of  the 
coherence  functions  by  refractive  systems.  The  astigmatic  coherence  sensor  consists  of  a 
set  of  spinning  cylindrical  lenses.  The  system  measures  transformations  of  the  mutual 
intensity  in  the  input  aperture  as  a  function  of  position  in  the  output  aperture,  longitudinal 
position  of  the  output  aperture  and  astigmatisim  of  the  refractive  system. 

The  ACS  is  particularly  noteworthy  in  two  respects: 

1 .  It  captures  the  mutual  intensity  without  the  bias  noise  associated  with  two-point 
correlations  and 

2.  It  captures  the  four-dimensional  mutual  intensity,  which  enables  analysis  of 
generally  partially  coherent  fields. 

Detailed  analysis  of  noise  issues  in  multiplex  imaging  systems  requires  assumptions 
regarding  the  nature  of  the  source.  Different  sensor  systems  are  adapted  to  different 
source  classes.  For  example,  focal  imaging  systems  are  well  adapted  to  sources  with  high 
entropy  across  a  plane  and  RSTs  tend  to  be  well  adapted  to  sparse  longitudinally 
distributed  sources.  The  ACS  is  an  existence  proof  of  the  possibility  of  wholly  new 
classes  of  sensor  system.  Ultimately  the  best  sensors  are  adapted  to  the  source  it  observes, 
detailed  comparative  research  into  the  adaptive  range  and  ideal  source  characteristics  of 
different  sensors  is  an  important  topic  for  continuing  study. 

We  wrote  two  manuscripts  describing  the  function  of  the  ACS,  one  on  the  basic  process 
of  coherence  measures  from  refractive  transformations  and  one  showing  distortion 
correction  by  four  dimensional  coherence  analysis.  These  manuscripts  are  included  as 
appendices. 

Tomographic  Analysis  of  Optical  Images 

Tomography  originally  referred  to  slice  selection  in  3D  object  analysis  by  coded 
illumination  and  sensing.  With  the  advent  of  computed  tomography,  however, 
tomography  has  referred  to  increasingly  broad  classes  of  multidimensional  source 
reconstruction  from  linear  projections.  Relationships  and  boundaries  between  physical 
data  capture  and  digital  reconstruction  have  become  interesting  research  topics  in  many 
modalities,  including  x-rays,  optics,  ultra-sound  and  radar. 

The  boundary  between  physical  and  digital  processing  for  source  estimation  is 
particularly  interesting  in  optics.  Optical  systems  have  generally  relied  on  very  simple 
relationships  between  sources  and  fields  (the  field  is  usually  assumed  to  be  simply 
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proportional  to  the  source)  and  on  physical  processing  for  source  estimation. 
Tomographic  analysis  allows  more  sophisticated  relationships  between  source  and  field. 
For  example,  tomographic  algorithms  automatically  account  for  the  fact  that  the  field  at  a 
given  source  point  may  include  contributions  from  other  source  points.  Optical  systems 
may  have  previously  attempted  to  account  for  this  fact  by  diffractive  deconvolution,  but 
robust  well-posed  inversion  has  been  relatively  rare. 

4Is  very  quickly  encountered  interesting  questions  on  the  boundary  between  focal 
imaging  and  tomography.  Tomography  is  by  nature  a  multiplex  imaging  technique.  Focal 
systems  assume  isomorphism.  On  the  one  hand,  it  is  not  possible  to  gather  tomographic 
projections  in  optical  systems  ray  by  ray,  on  the  other  hand  focal  systems  are  not  well- 
posed  for  projective  deconvolution. 

After  demonstrating  tomographic  projection  from  pinhole  and  focal  apertures  in  the 
papers  included  as  appendices  here,  the  4Is  project  addressed  the  issue  of  trade-offs 
between  aperture  processing  and  incoherent  tomographic  processing  in  the  RSI-based 
Science  article  mentioned  in  the  previous  section.  We  also  developed  a  detailed  model  for 
the  tomographic  patch  response  associated  with  using  conventional  CT  algorithms  on 
opaque  objects.  The  patch  response  was  the  subject  of  A.  J.  Johnson’s  Master  of  Science 
thesis  and  will  appear  in  a  future  manuscript. 

We  also  considered  the  efficiency  and  data  requirements  for  tomographic  processing,  as 
indicated  by  articles  (16)  and  (17)  in  the  publications  section. 

General  issues  regarding  trade-offs  between  tomographic  processing  of  incoherent 
aperture  data  and  coherent  analog  in-aperture  transformations  remain  unresolved  at  the 
time  of  this  report.  It  now  seems  clear  that  computational  imaging  systems  consisting  of 
large  arrays  of  low  resolution  apertures  may  achieve  comparable  or  even  superior  source 
estimation  performance  in  some  applications,  but  full  analysis  of  this  issue  awaits  further 
work. 

EtHcient  Source  State  Estimation 


4Is  demonstrated  by  existence 
that  many  physical  primitives, 
such  as  the  basic  size,  radiation 
pattern  and  spectrum,  of 
sources  may  be  abstracted 
more  efficiently  than  digital 
analysis  of  isomorphic  sensor 
data.  Detailed  comparative 
analysis  of  different  sensors  for 
different  source  analysis  tasks 
awaits  further  work.  This 
section  presents  a  short 
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explanation  of  the  potential  for  feature  specific  sensor  systems. 

Consider  a  source  occupying  a  spherical  space,  as  shown  above.  We  measure  correlations 
between  field  points  on  a  measurement  sphere  surrounding  the  source.  The  3D  van 
Cittert-Zemike  theorem  for  this  geometry  takes  the  form 

2 

fV(As,y)  =  mr-  v)e  d^r,  where  fT(A5,v')is  the  cross  spectral  density  between 
the  fields  drawn  from  points  separated  by  on  the  measurement  sphere.  5'(r,i/)is  the 
4D  source  density. 

Efficient  source  state  estimation  is  based  on  the  idea  that  one  wishes  to  estimate  some 
particular  projection  of  5(r,v),  rather  than  an  isomorphic  map.  In  this  case,  one  may 

choose  to  modulate  on  measurement.  If  one  multiplies  fV  (As,y)  by  a 

modulating  function  and  integrates  one  obtains 

jfV  (As,v)^(As,v)<i^AsJv  =  js(r,y)V(r,v)d^rdv, 


where  V(r,v)  =  jjji^(As  ,v)e  ‘  d'r  ,  meaning  that  we  obtain  a  arbitrary  projection  of 

the  source  state  by  appropriately  weighting  the  mutual  coherence  measurement. 

As  part  of  the  4Is  project,  we  experimentally  explored  the  possibility  of  efficient 
abstraction  of  source  primitives  by  using  volume  holographic  filters  and  by  filtering  of 
nonlocal  projections  from  RSI  data.  The  RSI  experiments  are  discussed  in  Jason 
Gallicchio’s  dissertation  in  the  appendix.  Volume  holographic  sensor  systems  for 
confocal  prefilters  and  other  efficient  sensor  systems  are  described  in  attached 
manuscripts. 

Optimal  filtering  schemes  for  target  analysis,  as  in  direct  measurement  of  specific  spatio- 
spectral  target  features,  requires  further  analysis  of  the  range  of  holographic,  diffractive 
and  sensor  plane  filtering  operations.  This  approach  may  be  particularly  attractive  for 
identification  and  tracking  of  distributed  biological  and  chemical  targets. 

Limits  of  Multiplex  Imaging 

Dramatic  increases  in  processing  power  have  made  Fourier,  Hadamard  and  other 
multiplex  coding  schemes  increasingly  attractive  for  spatial  sensor  systems.  Multiplex 
system  analysis  common  to  spectral  multiplex  sensors  is  not  directly  applicable  to 
spatially  complex  systems,  however,  because  the  constant  radiance  theorem 
geometrically  restricts  spatial  multiplexing.  The  constant  radiance  theorem  effectively 
couples  sensor  size  and  multiplexing,  meaning  that  as  more  modes  are  multiplexed  on 
measurement  sensor  size  must  grow  to  maintain  quantum  efficiency. 
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We  have  recently  published  an  analysis  of  the  constant  radiance  theorem  in  this  context 
in  Optics  Letters.  This  analysis  is  included  as  an  appendix. 

Technology  Development  and  Transfer 

Technologies  developed  imder  4Is  are  being  transferred  to  military,  security,  biomedical 
and  control  applications.  The  basic  sensor  science  developed  under  4Is  directly  lead  to 
applied  programs  under  the  DSO,  TTO  and  MTO  offices  at  DARPA  aimed  at 
multidimensional  microscopies,  ground  sensor  and  efficient  hyperspectral  imaging 
systems.  The  integrated  sensing  and  processing  community  grew  dramatically  over  the 
three  year  life  of  this  program  and  has  spawned  a  new  Optical  Society  of  America  topical 
meeting,  a  week-long  symposium  on  “Frontiers  of  Imaging”  at  the  2002  Optical  Society 
Annual  meeting  and  many  new  research  projects  around  the  nation.  While  relatively  few 
advanced  computational  imaging  systems  are  currently  deployed,  events  are  moving  very 
quickly  in  this  area. 

The  birefringent  sampling  field  sensor  is  the  only  patent  cuitently  pending  derived  from 
the  4Is  program,  but  several  additional  disclosures  from  technologies  related  to  this 
program  have  been  filed  with  the  Duke  University  Office  of  Science  and  Technology  in 
response  to  advances  under  the  multidimensional  microscopy  plan. 

As  mentioned  above,  technologies  developed  under  4Is  form  the  basis  of  two  small 
companies,  Phase  Optics,  Inc.  and  Distant  Focus  Corporation.  Phase  Optics 
(www.phaseoptics.com)  has  licensed  SFS  technology  from  the  University  of  Illinois  and 
is  building  a  prototype  metrology  system  for  manufacturing  process  control  based  on  this 
sensor.  Distant  Focus  (www.distantfocus.com)  is  working  with  Raytheon  on  large  sensor 
arrays  and  multiplex  spatio-spectral  tracking  systems. 

Relationships  developed  through  the  4Is  program  with  the  Army  Research  Lab  and  with 
the  Air  Force  Research  Lab  are  continuing,  visits  by  the  program  PI  to  ARL  in  Maryland 
and  AFRL  in  Ohio  are  planned  for  early  2002.  Both  labs  were  well  represented  at  the 
Integrated  Computational  Imaging  Systems  OSA  topical  meeting  in  the  fall  of  2002,  at 
which  opportunities  derived  from  this  program  were  discussed. 

Opportunities 

As  indicated  in  the  previous  sections,  4Is  achieved  dramatic  demonstrations  that  the 
information  gathering  and  image  formation  roles  of  optical  imaging  systems  could  and 
should  be  separated.  As  is  often  the  case,  however,  this  investigation  uncovered  more 
unsolved  mysteries  than  it  solved.  Until  very  recently,  sensor  system  design  was 
extremely  ad  hoc.  Different  sensors  were  compared  only  with  sensors  based  on  similar 
design  principles.  In  the  next  generation,  sensor  systems  of  different  classes  will 
increasingly  be  compared  based  on  task-specific  functionality. 

Throughout  this  report  we  have  emphasized  the  term  “sensor”  over  “imaging  system.” 
We  make  this  distinction  because  in  most  cases  the  output  of  the  system  is  not  an  image. 
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rather  it  is  a  control  or  alarm  signal  associated  with  target  analysis.  Until  recently,  sensors 
were  designed  by  post  processing  of  imaging  system  data.  We  hope  that  the  most 
significant  contribution  of  the  4Is  project  will  be  broader  realization  that  it  is  possible  to 
design  physical  layer  components  to  sense  data  specific  to  sensor  tasks  and  that 
integrated  physical  and  mathematical  design  will  dramatically  improve  sensing. 

Personnel 

Graduate  research  assistants  partially  supported  under  this  program  included: 

Daniel  Marks,  Remy  Tumbeir,  Jason  Gallichio,  Prasant  Potuluri,  A.  J.  Johnson  and  Evan 
Cull. 

These  students  completed  7  master  of  science  dissertations  and  2  Ph.  D.  dissertations 
using  results  from  this  program.  These  theses  are  listed  below  in  the  publications  section. 

Staff  and  postdoctoral  fellows  supported  under  this  program  included: 

Ronald  Stack  (currently  president  of  Distant  Focus  Corporation),  Matt  Fetterman 
George  Barbastathis  (currently  Assistant  Professor  of  Mechanical  Engineering  at  MIT), 
Rick  Morrison  (CSO  of  Distant  Focus),  and  Michal  Balberg 

Faculty  contributing  to  this  program  included 

David  J.  Brady,  David  C.  Munson,  Jr.,  Eric  Michielssen 

Publications 

Copies  of  many  of  the  publications  derived  from  this  program  are  attached  in  the 
appendix. 

Manuscripts  derived  in  whole  or  in  part  from  this  program  remaining  in  press  include: 

1.  Brady,  D.  J.,  Multiplex  sensors  and  the  constant  radiance  theorem,  to  appear  in 
Optics  Letters 

2.  Marks,  D.  L.,  R.  Stack  and  D.  J.  Brady,  Digital  refractive  distortion  correction  using 
the  astigmatic  coherence  sensor,  submitted  to  Applied  Optics 

3.  Johnson,  A.  J.,  D.  L.  Marks,  D.  Munson  and  D.  J.  Brady,  Surface  abstraction  from 
tomography  of  opaque  objects  using  the  CLEAN  algorithm,  in  preparation 

4.  Tumbar,  R.  and  D.  J.  Brady,  Birefringent  sampling  field  sensors,  in  preparation. 

5.  Gallicchio,  J.,  D.  J.  Brady,  E.  Cull,  Spatio-spectral  triangulation  of  point  sources 
using  the  rotational  shear  interferometer 
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imaging  using  an  interferometric  camera.  Optics  Express,  2001 .  8(1 1):  p.  624-630. 

2.  Marks,  D.L.,  R.  Stack,  A.J.  Johnson,  D.J.  Brady,  and  D.C.  Munson,  Cone-beam 
tomography  with  a  digital  camera.  Applied  Optics,  2001.  40(11):  p.  1795-1805. 

3.  Tumbar,  R.,  R.A.  Stack,  and  D.J.  Brady,  Wave-front  sensing  with  a  sampling  field 
sensor.  Applied  Optics,  2000.  39(1):  p.  72-84. 

4.  Marks,  D.,  M.  Fetterman,  R.  Stack,  and  D.J.  Brady.  Spectral  tomography  from  spatial 
coherence  measurements,  in  Proceedings  of SPIE  -  The  International  Society  for 
Optical  Engineering.  2000.  San  Jose  CA  Bellingham  WA:  Society  of  Photo-Optical 
Instrumentation  Engineers. 
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CHAPTER  1 .  INTRODUCTION  AND  OVERVIEW 


1.1  Introduction 

Optical  sensors  are  used  in  a  broad  range  of  applications.  These  include  classical  imaging 
systems,  tomographic  systems,  and  interferometric  and  noninterferometric  sensors  for 
amplitude,  phase,  or  polarization.  The  imaging  paradigm  itself  has  changed  from  producing 
a  point-to-point  mapping  of  the  intensity  distribution  of  an  object  to  producing  an  intensity 
representation  which  is  not  necessarily  a  point-to-point  map.  Recent  developments  in 
computational  hardware  and  software  have  allowed  a  wider  use  of  computational  imaging 
systems  and  sensors,  which  rely  in  extensive  postdetection  processing  of  the  sensor  data  in 
order  to  reconstruct  the  object  or  the  sensed  parameter  distribution.  Examples  of  such 
imaging  systems  are  wavefront  sensors  like  the  Shack-Hartmann  sensor  (SHS)  [1]  and  the 
sampling  field  sensor  (SFS)  [2],  tomographic  systems,  and  interferometric  imaging  systems 
like  the  rotational  shearing  interferometer  (RSI)  [3].  The  use  of  computers  to  extensively 
process  sensor  data  allows  greater  freedom  in  the  sensor  design  process  resulting  in  a  better 
accomplishment  of  the  given  imaging  task.  Ideally  one  would  optimize  the  optical  sensing 
system  considering  the  object  or  field  parameter  to  be  “imaged,”  system  resources, 
input/output  field  statistics,  and  noise  sources.  This  would  result  in  an  optical  sensor  tailor- 
made  for  each  particular  situation.  The  classical  imaging  goal  has  thus  shifted  towards 
efficiently  and  reliably  getting  the  maximum  amount  of  information  from  the  input  optical 
field. 

As  a  particular  case  of  optical  sensors  we  consider  wavefront  sensors,  which  measure 
the  phase  and  amplitude  of  the  input  optical  field.  Their  traditional  use,  for  measuring  the 
quality  of  optical  lenses,  has  diversified  in  light  of  the  above-mentioned  computational 
imaging  trend.  They  are  now  used  for  imaging  through  turbulent  media  using  adaptive  optics 
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[4]  or  deconvolution  from  vv^avefront  sensing  [5],  or  for  tomographic  reconstructions  of 
transparent  objects  [6].  Other  applications  include  optical  testing,  eye  aberration 
measurements  [7]  for  eye  surgery,  and  diffractive  element  characterization  [8].  Wavefront 
sensors  have  long  posed  problems  in  their  use  for  two  reasons.  First  the  phase  of  the  optical 
field  is  not  available  directly,  but  it  has  to  be  coded  into  intensity  measurements.  In  some 
cases  this  leads  to  multiple-shot  interferometric  sensors,  which  cannot  be  used  in  real  time. 
Second,  most  of  them,  especially  interferometric  sensors,  are  very  sensitive  to  mechanical 
vibrations  encountered  in  a  nonlaboratory  environment.  The  latter  has  prevented  their 
widespread  use  as  well  as  their  consideration  for  even  more  applications.  The  SHS 
overcomes  both  of  these  problems.  This  fact  has  driven  its  proliferation  in  various 
applications  such  as  astronomic  imaging,  laser  corrective  eye  surgery  [7],  laser  beam  and 
lens  quality  measurements,  and  others.  However,  the  SHS  has  a  low  information  capacity 
when  measured  as  the  space-bandwidth  product  [2].  We  propose  a  new  type  wavefront 
sensor,  the  SFS.  The  SFS  is  compact  and  vibration-insensitive.  It  has  a  high  space- 
bandwidth  product  and  it  takes  all  the  data  in  one  shot,  making  it  a  strong  candidate  for  real¬ 
time  applications.  Its  principle  of  operation  and  a  description  of  its  first-generation 
implementation  are  described  in  a  recent  paper  [2]. 

1.2  Sampling  and  Spatial  Multiplexing 

Interferometric  shearing  wave-front  sensors  use  different  methods  to  create  two  laterally 
shifted  or  sheared  copies  of  the  input,  which  they  interfere  at  the  output  plane.  In  addition, 
the  relative  phase/optical  path  delay  of  one  of  the  copies  with  respect  to  the  other  is  changed 
and  multiple  phase-shifted  frames/shots  of  the  output  are  recorded.  This  is  done  by  moving 
mirrors,  moving  gratings,  moving  wave  plates,  and  other  means.  These  operations  may 
remove  degeneracies  (like  in  the  estimating  the  phase  angle  from  its  cosine  value,  which  is 
measured  by  interferometers)  or  they  may  increase  the  accuracy  of  the  estimate  in  the 
presence  of  noise.  The  so-called  phase-shift  algorithms  are  used  for  that  purpose.  Usually 
this  is  done  for  each  lateral  shear  direction  separately. 
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The  wavefront  map  is  reconstructed  from  measurements  of  the  phase  differences  between 
adjacent  points  in  the  input  aperture  separated  by  the  shearing  distance  in  the  direction  of  the 
shear.  A  problem  arises  when  the  input  changes  (e.g.,  a  pulsed  or  variable  field)  or  when  the 
system  also  changes  uncontrollably  between  the  measurements,  thus  reducing  the  accuracy  of 
the  result.  A  common  solution  used  to  achieve  one-shot  detection  in  multishot  systems  is  the 
use  of  multipath  system  implementations.  This  amounts  to  splitting  the  input  field  and 
sending  it  through  different  optical  paths  into  different  subsystems  with  specific  functions, 
such  as  shear  along  x,  or  shear  along  y,  or  specific  phase  delays  [9]. 

We  use  sampling  and  space  multiplexing  to  generate  the  required  phase  shift  and 
shear  diversity  information  in  fewer  frames  than  usually  necessary,  even  in  a  single  frame. 
In  addition,  the  shear  and  phase-shift  diversity  information  is  generated  along  an  essentially 
common  optical  path.  Thus,  the  present  method  eliminates  the  disadvantages  related  to 
multipath  methods,  which  are  the  current  solution  to  turning  multishot  systems  into  single¬ 
shot  ones.  These  disadvantages  include  increased  sensitivity  to  vibrations,  increased 
complexity  and  size  of  the  system,  and  poorer  reliability  (due  to  increased  complexity).  The 
wavefront  sensing  systems  we  describe  in  this  work  are  compact  and  much  less  sensitive  to 
vibrations  and  misalignment  than  other  interferometric  sensors 

By  sampling  the  input  field  we  obtain  a  sparse  version  with  blocked  regions 
separating  the  samples.  We  then  use  the  empty  space  between  the  samples  to  generate 
additional  information  about  the  input  such  as  shearing  interferometric  measurements  on 
multiple  directions  and  phase-shifted  measurements.  We  call  diversity  information  the  set  of 
multiple  measurements  used  in  estimating  the  input.  This  work  presents  two  different  ways 
of  generating  the  diversity  information. 

The  sampled  field  diffracts,  through  free-space,  creating  overlapping  patterns  at  the 
output  of  the  device.  The  patterns  produce  sheared  interferometric  measurements  along  the 
Cartesian  direction  and  their  phase  curvature  gives  additional  phase-diversity  information. 
This  implementation  of  our  method  suffers  from  very  low  light  throughput,  small  angular 
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bandwidth,  and  larger  cross-talk  between  the  measurements  than  the  second  method.  It  is, 
however,  extremely  cheap,  since  it  can  be  done  by  mounting  a  sampling  mask  about  a 
millimeter  away  in  front  a  CCD  chip. 

The  second  implementation  generates  the  diversity  information  by  imaging  the  input 
or  sampling  plane  to  the  output  of  the  system  rather  than  letting  it  diffract  in  free  space. 
Multiple,  appropriately  modified  copies  of  the  samples  are  produced  at  the  output  by  using 
birefringent  plates  that  split  the  optical  field  in  multiple  components  propagating  in  different 
directions.  The  geometrical  layout  of  the  patterns  allows  overlap,  which  further  produces 
multiple  phase-shifted  and  sheared  interferometric  measurements.  Due  to  imaging  the 
sampled  field,  throughput  two  orders  of  magnitude  larger  than  that  of  the  previous  method  is 
achieved  while  minimizing  the  cross-talk.  The  new  system  achieves  phase  sensitivity 
comparable  to  high-performance  phase  shift  systems  while  being  virtually  insensitive  to 
vibrations. 

1.3  Overview  of  Previous  Work  on  Wavefront  Sensors  and  Phase- 

Estimation  and  Reconstruction  Aigorithms 

Wavefront  sensors  include  interferometric  and  noninterferometric  systems  [10].  Shearing 
interferometers,  point  diffraction  interferometers  [11],  and  the  pseudo-phase-conjugate 
interferometer  [12]  are  a  few  examples  of  interferometric  wavefront  sensors.  Non¬ 
interferometric  wavefront  sensors  include  the  Shack-Hartmann  sensor  (SHS)  [1]  and  the 
curvature  sensor  [13]  with  the  SHS  being  the  most  commonly  used  wavefront  sensor.  The 
SHS  is  constructed  by  mounting  an  array  of  lenses  in  front  of  an  array  of  detectors.  The 
detectors  determine  the  position  of  the  focal  spot  intensity  centroid  of  each  lens.  The  set  of 
centroid  positions  for  a  normally  incident  plane  wave  serves  as  a  zero  reference.  The  offsets 
between  the  detected  centroids  for  an  arbitrary  input  wavefront  and  the  zero  reference 
positions  provide  measures  of  the  average  wavefront  tilt  coefficients  over  each  lens  sub¬ 
aperture.  The  input  wavefront  is  then  reconstructed  via  data  reduction  techniques  using  these 
average  tilt  measurements. 
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Optical  wavefront  sensors  code  phase  information  into  intensity  information  in  their 
output,  making  two  additional  steps  necessary  compared  to  lower  frequency  phase  sensors. 
The  first  step  is  the  phase  estimation:  use  the.  intensity  measurements  in  the  sensor  output  to 
reliably  and  efficiently  estimate  the  input  phase  or  an  invertible  representation  of  the  input 
phase.  Usually,  this  step  gives  the  input  phase  in  the  form  of  exact  finite  differences  between 
adjacent  points  on  a  Cartesian  grid  for  shearing  interferometers  and  the  SFS.  In  the  SHS  case 
the  average  tilt  coefficients  given  by  the  sensor  are  estimated  using  the  intensity  centroids  in 
the  output  plane  of  the  sensor  and  not  regular  phase  estimation  algorithms.  The  second  step 
is  the  phase  reconstruction.  This  amounts  to  reconstructing  the  input  phase  distribution  as  a 
continuous  function  from  the  results  at  the  previous  step.  Since  both  steps  apply  in  the  SFS 
case,  we  consider  them  to  be  connected  to  the  problem  of  SFS  design  and  testing. 

The  most  important  class  of  phase  estimation  algorithms  in  optics  is  that  of  phase- 
shifting  interferometry  algorithms.  Creath  [14]  gives  a  good  review  of  the  subject.  The  idea 
is  to  sample  the  waveform 

l{S)=I^+loCos{(p  +  S)  (1.1) 


for  different  values  of  S  and  use  the  samples  to  estimate  cp  in  the  [-71,  tc)  interval.  Given  that 
h,  h,  and  (p  are  the  unknowns,  one  needs  only  three  measurements  to  estimate  these 
unknowns  with  infinite  accuracy  if  there  are  no  sources  of  noise  or  systematic  errors. 
However,  there  are  significant  systematic  as  well  as  random  errors  in  the  actual  physical 
measurements.  The  main  trend  in  phase-shifting  algorithm  design  has  been  to  design 
algorithms  which  are  insensitive  to  a  given  set  of  systematic  errors,  at  the  expense  of  having 
more  than  three  samples  of  Eq.  (1.1).  In  general,  the  phase  estimate  is  obtained  fi'om 
multiple  measurements  using 


(p  =  tan 


~) 


{  M  \ 

1=1 


M 


V*=i 


(1.2) 


where  4  are  the  phase  shifts,  and  the  coefficients,  and  l(5k)  the  measurements  in  an  M- 
frame  algorithm.  Waveform  nonlinearity  and  phase-shift  miscalibration  are  the  main  sources 
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of  errors  considered.  The  emphasis  given  to  systematic  errors  stemmed  from  the  poor 
repeatability  of  the  phase-shift  devices  and  from  the  nonlinearity  of  focal  plane 
detectors  [14].  One  can  eliminate  the  first  problem  by  using  separate  motion  detectors,  either 
in  the  form  of  a  parallel  interferometer  or  a  magnetic  position  sensor,  for  example.  Spatially 
nonuniform  phase  shifts  are  harder  to  compensate.  Some  phase  estimation  algorithms  [15] 
eliminate  systematic  errors  up  to  a  given  order  by  considering  the  Fourier  expansion  of  I(^ 
in  exp(iw^)  and  making  the  coefficients  for  w  9^  1  equal  zero.  This  causes  the  roots  of  a 
certain  polynomial  to  be  on  the  unit  circle. 

Another  approach  [16]  is  to  add  error  terms  to  the  ideal  form  of  Eq.  (1.1)  either  in  the 
argument  of  the  cosine  (phase  calibration  errors  or  nonlinear  phase  shifter)  or  as  nonlinearity 
of  the  lo  term  due  to  multiple  beam  interference  or  nonlinearity  of  the  intensity  detector.  By 
forcing  the  coefficients  of  the  error  terms  to  be  zero  one  obtains  a  set  of  equations  for  the 
coefficients  of  the  phase  estimating  algorithm.  Hibino  [17]  has  proven  that  algorithms  that 
compensate  for  both  the  harmonics  of  the  nonlinearity  and  the  phase  shift  miscalibration  are, 
in  general,  more  susceptible  to  errors  caused  by  random  noise.  The  solution  he  suggested 
was  to  use  even  more  measurements  than  the  minimum  number  required  by  the  elimination 
of  systematic  errors.  This  would  increase  the  signal-to-noise  ratio  (SNR)  but  not  completely 
eliminate  the  errors. 

A  third  approach  is  to  consider  all  the  errors  to  be  random  and  to  use  maximum- 
likelihood  estimation  theory  to  estimate  the  phase  from  a  given  set  of  measurements  [18], 
[19].  Rogala  [18]  also  used  the  Cramer-Rao  lower  bound  as  a  performance  measure  of  the 
experimental  setup  used  to  identify  the  best  way  of  taking  the  measurements.  This  last 
approach  has  found  only  a  few  followers  for  two  reasons,  in  our  opinion.  First,  the  results  of 
the  estimation  can  depend  rather  strongly  on  the  noise  model  used.  Using  the  wrong  noise 
model  can  give  poorer  results  than  expected.  In  particular,  Rogala's  choice  of  the  noise 
models  was  rather  ad-hoc.  Secondly,  the  statistics  of  systematic  errors  may  be  very  difficult 
to  estimate  due  to  their  large  high-order  moments.  This  hinders  the  proper  use  of  statistical 
estimation  methods  like  the  ML  method.  A  stronger  (exact)  cancellation  of  errors  is 
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required,  which  is  provided  by  the  deterministic  algorithms  obtained  by  the  first  and  second 
design  methods. 

Phase  reconstruction  from  sensor  data  appears  in  two  forms.  The  first  is  the  phase 
map  reconstruction  from  exact  or  average  finite  differences  that  appears  mostly  in  shearing 
interferometry  problems.  Since  the  SFS  outputs  data  similar  to  a  shearing  interferometer, 
this  problem  is  connected  to  this  work.  The  problem  of  unwrapping  two-dimensional  phase 
maps  is  related  to  reconstruction  from  phase  differences  because  the  usual  approach  is  first  to 
form  the  phase  differences  and  then  to  reconstruct  the  unwrapped  phase  map  from  these 
differences.  Therefore,  much  of  the  work  done  on  phase  unwrapping  algorithms  applies  to 
our  problem  of  phase  reconstruction  from  finite  differences.  The  second  form  of  phase 
reconstruction  from  sensor  data  can  be  viewed  as  an  inverse  problem:  one  uses  the  intensity 
distributions  in  the  output  plane  of  a  sensor  to  reconstruct  the  input  phase  map.  It  is  not 
directly  related  to  the  SFS,  at  least  in  its  implementations  considered  for  this  work.  It  is, 
however,  an  important  problem  in  the  general  setup  of  wavefront  sensor  design.  Its  study 
will  point  out  to  advantages  and  disadvantages  of  using  certain  types  of  wavefront  sensors 
and  wavefront  sensing  methods  in  certain  situations.  As  a  result,  one  can  design  improved 
wavefront  sensors  and  wavefront  reconstruction  algorithms. 

Historically,  there  are  two  classes  of  wavefront  reconstructions  from  phase 
differences:  zonal  [20,  21]  and  modal  reconstructions  [22-24].  It  is  easy  to  show,  however, 
that  the  classical  zonal  reconstruction  method  is  in  fact  a  modal  reconstruction  when  the 
expansion  modes  are  sine  functions  and  the  number  of  expansion  modes  is  equal  to  the 
number  of  measurement  points  within  the  sensor's  aperture.  Equations  (1.3)  and  (1.4)  show  a 
matrix  of  zonal  and  modal  representations,  respectively,  of  the  wavefront  reconstruction 
problem: 

g  =  (1.3) 

g  =  AZc  (1.4) 
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where  <|)d  is  the  grid  of  sampled  wave  frontphase  values,  c  is  the  set  of  coefficients 
representing  the  wave  front  phase  in  the  chosen  basis,  Z  is  the  operator  having  the  basis 
vectors  as  columns,  and  A  is  the  finite  difference  operator,  given  by 


1  -1 
1  -1 


A  =  1 


1 


1  -1 
1  -1 


1  -1 
1  -1 


-1 


-1 


1 


-1 

1  -1 
1  -1 
1  -1 

111111111 


(1-5) 


for  the  case  of  a  3  x  3  phase  map.  A  zonal  reconstruction  will  estimate  the  vector  (|)d  of 
sampled  phase  values,  whereas  a  modal  one  will  find  the  coefficient  vector  c.  In  general,  the 
size  of  the  modal  coefficient  vector  is  smaller  than  the  size  of  the  phase  array.  However,  a 
choice  of  the  modal  basis  in  the  form  of  sine  functions,  with  the  size  equal  to  the  number  of 
points  in  the  array,  makes  Eqs.  (1.3)  and  (1.4)  the  same.  The  purpose  of  using  modal 
representations  is  only  partially  revealed  by  the  problem  of  wavefront  reconstruction  from 
the  phase  differences.  The  remaining  part  will  be  given  when  discussing  the  problem  of 
wavefront  reconstructions  from  sensor  data.  For  now  the  motivation  relies  on  the  fact  that 
modal  representations  may  use  lower-dimensionality  spaces  to  estimate  the  input.  This 
assumes  that  the  input  has  in  fact  fewer  degrees  of  freedom  than  its  number  of  grid  points.  If 
one  adds  noise  in  the  left-hand  side  (LHS)  of  Eqs.  (1.3)  and  (1.4),  the  reconstruction  error 
will  not  increase  with  more  grid  points  as  in  the  case  of  zonal  reconstructions  where  it  scales 
as  l/jiln(N).  The  scaling  law  has  been  explained  by  Noll  [25]  by  using  Green  functions  and 
by  Menikkoff  [26]  by  using  a  cosine  series  representation  of  the  finite  difference  operator.  In 
short,  both  explanations  boil  down  to  the  1/k^  dependence  of  the  spatial  power  density  of  the 
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wavefront,  <(l)d*(k)(t)d(k)>.  White  noise  in  the  phase  differences  will  produce  a  1/k^ 
dependence  of  the  error.  Increasing  the  number  of  points  gives  rise  to  smaller  wave  numbers 
and  therefore  to  larger  errors.  If  the  input  that  had  given  rise  to  the  phase  difference  data  is 
not  in  the  range  space  of  the  Z  operator,  the  reconstruction  will  be  biased  (increased 
modeling  error).  Two  other  problems  with  modal  reconstructions  are  aberration  coupling 
and  aberration  aliasing.  The  nonorthogonality  of  the  expansion  modes  causes  the  first 
problem,  while  their  linear  dependence  causes  the  second  [23].  Both  are  effects  of  the  finite 
sampling,  which  makes  higher-order  modes,  having  more  structure,  similar  to  lower-order 
ones.  The  basis  most  widely  used  is  that  of  Zemike  polynomials  because  it  represents  well 
the  aberration  terms  in  an  optical  system.  It  has  been  argued  that  it  is  not  a  good  basis  for 
more  general  wavefront  reconstruction  problems  [27].  In  wavefront  sensing  of  Kolmogorov 
turbulence  (atmospheric  adaptive  optics),  for  example,  the  best  basis  is  the  Karhunen-Loeve 
set.  This  approach  can  be  used  in  a  more  general  situation  given  that  the  statistics  of  the 
input  wavefront  are  known.  Legendre  polynomials  and  Fourier  sets  are  also  widely  used  due 
to  their  orthogonality  on  square  domains. 

Both  the  zonal  and  the  modal  problem  are  usually  solved  in  a  least-squares  sense. 
This  is  common  to  the  phase  unwrapping  techniques  that  first  form  the  phase  differences  and 
then  do  a  minimization  of  the  least-squares  error.  The  advantage  of  this  technique  is  in 
allowing  the  use  of  fast  elliptic  solvers  [28].  It  has  been  argued  (mainly  in  phase  unwrapping 
works)  that  the  L^-norm  error  minimization  produces  biased  reconstructions.  This  can  be 
explained  in  two  ways.  One  is  to  note  that  the  phase  reconstruction  problem  becomes  that  of 
solving  Poisson's  equation  with  an  appropriately  constructed  source  term  and  Neumanii 
boundary  conditions  [28].  The  source  term  is  large  in  regions  where  there  are  large  phase 
differences  such  as  noisy  or  aliased  (phase  difference  larger  than  k)  regions.  Solving  the 
Poisson's  equation  is  a  deconvolution  problem.  The  deconvolution  kernel  is  a  low-pass  filter 
since  the  Laplacean  operator  is  a  high-pass  one.  This  explains  the  tong  range  of  the 
distortions  in  the  reconstruction.  A  more  interesting  explanation  has  been  suggested  by  Fried 
[29]  using  the  concept  of  branch  points.  Noise  in  the  phase  estimation  process  and  aliasing 
in  the  actual  input  phase  map  give  rise  to  a  solenoidal  component  of  the  phase  field.  This 
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does  not  appear  in  the  source  term  of  the  corresponding  Poisson  equation  constructed  in  the 
least-squares  approach.  It  can  be  added  by  postulating  its  existence  and  adding  a  dipole  term 
to  the  reconstructed  phase  map  [29],  [30].  It  has  also  been  argued  that  using  more  general 
norms,  especially  L°  and  L',  will  give  better  reconstructions  by  forcing  the  gradient  of  the 
reconstructed  map  to  follow  that  of  the  input.  The  use  of  the  L**  norms  in  the  context  of  the 

solenoidal  phase  term  has  not  been  studied. 

Modal  reconstructions  are  also  used  in  the  context  of  a  more  general  problem: 
reconstructing  the  input  phase  map  from  intensity  distributions  in  the  output  plane  of  the 
wavefront  sensor.  The  SHS  gives  the  best  example  because  of  its  wide  practical  use.  It  is 
constructed  by  mounting  an  array  of  lenses  in  front  of  an  array  of  detectors,  like  a  CCD 
camera.  Each  lens  focuses  the  wavefront  incident  on  it  onto  a  corresponding  region  of  the 
detector  array.  From  elementary  diffraction  theory  one  can  show  that  the  field  at  the  detector 
plane  is  a  scaled  Fourier  transform  of  the  field  incident  onto  the  respective  lens  [31]. 
Therefore,  the  SHS  output  field  consists  of  a  set  of  windowed  Fourier  transforms  of  the  input 
field.  The  actual  sensor  data  is  an  absolute  value  squared  of  the  output  field  distribution. 
The  centroid  of  the  intensity  distribution  in  each  lens  output  region  of  the  output  plane  is 
proportional  to  the  average  tilt  coefficient  over  that  of  the  input  wavefront  over  the  lens  sub¬ 
aperture  [1].  The  input  phase  map  is  reconstructed  by  either  assuming  that  the  average  tilts 
are  good  estimates  of  the  actual  discrete  phase  differences  or  by  considering  a  modal 
representation  of  the  input,  computing  the  range  space  of  its  corresponding  sensor  output, 
and  projecting  the  average  tilt  measurements  onto  that  range  space.  We  have  a  zonal 
reconstruction  in  the  first  case  and  a  modal  one  in  the  second.  In  this  case,  the  advantage  of 
the  modal  reconstruction  consists  in  providing  an  extended  representation  of  the  input 
wavefront,  beyond  the  combination  of  subaperture  tilts.  This  is  in  contrast  to  the  problem  of 
modal  phase  reconstruction  from  the  phase  differences  where  a  better  representation  of  the 
input  amounted  to  using  a  smaller  basis  set,  thereby  limiting  the  influence  of  noise.  Also,  the 
representation  of  the  input  by  using  sine  functions  does  not  make  modal  reconstruction 
equivalent  to  the  zodal  one  in  the  way  it  does  for  reconstruction  from  phase  differences.  The 
reason  is  the  nonlinear  dependence  between  the  input  and  the  output  measurements  and  the 
fact  that  only  the  subaperture  averaged  wavefront  tilts  are  estimated  from  the  measurements. 
A  more  radical  approach  to  this  inverse  problem  is  to  use  all  the  information  in  the  output 
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plane  of  the  sensor,  not  only  the  intensity  centroids  [32].  This  results  in  recovering  more  of 
the  structure  of  the  input  wavefront.  This  approach  is,  however,  very  demanding  from  a 
computational  standpoint.  Given  the  set  of  applications  where  the  SHS  is  the  best  choice,  a 
refinement  of  this  technique  is  needed. 


1.4  High-Space-Bandwidth  Wavefront  Sensing  by  Sampling  and  Spatial 
Multiplexing 

The  space-bandwidth  product  (SBP)  of  an  optical  system  can  be  defined  in  different  ways 
[33].  One  is  to  consider  the  space  domain,  another  one  is  to  consider  the  spatial  frequency 
domain,  and  the  third  is  to  consider  the  space/spatial  frequency  domain  by  using  the  Wigner 
transform.  All  the  above  produce  a  number  which  is  invariant  under  the  transforms  related  to 
imaging  with  a  lens,  free-space  diffraction,  and  under  the  Fourier  transfonn  [33].  Therefore 
this  number  is  a  good  measure  of  the  information  capacity  of  an  imaging  system.  The  space 
domain  definition  of  the  SBP  is 

SBP  =  IB^ByL^Ly  +  2  ^  IB^ByL^Ly  (1.6) 


where  the  factor  of  2  applies  to  coherent  sensors  only  and  the  last  term  is  the  minimum 
number  of  degrees  of  freedom  required  to  specify  a  coherent  field.  The  large  number  of 
degrees  of  freedom  in  optical  systems  justifies  the  approximation  in  Eq.  (1.6).  Equation  (1.6) 
does  not  account  for  the  state  of  poljirization.  The  factors  Bx  and  By  are  the  spatial 
bandwidths  in  the  x  and  y  directions,  respectively.  The  factors  Lx  and  Ly  are  the  dimensions 
of  the  sensor  aperture  in  the  x  and>^  directions,  respectively.  The  spatial  bandwidths  are  less 
or  equal  to  the  Nyquist  limits  given  by  sampling  in  both  Cartesian  directions,  as  the  sensor 
may  have  additional  bandwidth  limitations.  Consider  the  Nyquist  limits  to  be  Mlhx  and  Mlhy 
and  the  actual  spatial  bandwidths  to  be  the  fractions  gjlhx  and  gyJ2hy,  with  gx  and  gy  less  than 
1 .  Then  the  SBP  of  a  given  sensor  will  be 


SBP  =  gxgy 


Ih^hy 


(1.7) 


As  explained  earlier  in  this  chapter,  the  most  common  examples  of  optical  wavefront 
sensors  are  phase-shift  shearing  interferometers  and  Shack-Hartmann  sensors.  We 
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performed  numerical  simulations  on  the  SHS  (see  Chapter  2)  and  found  that  =  gy  «  0.1. 
This  is  due  mainly  to  the  fact  that  the  SHS  outputs  average  phase  differences  for  each 
sampling  period.  The  mean  value  theorem  can  be  used  to  prove  that  the  averages  come 
closer  to  the  actual  differences  as  the  bandwidth  of  the  signal  decreases.  Ten  times 
oversampling  gave  about  20%  reconstruction  error.  Also,  the  lenslets  in  the  lenslet  array  of 
the  SHS  are  difficult  to  make  with  a  lateral  dimension  less  than  approximately  50  pm,  which 
gives  the  sampling  distances  hx  and  hy  for  this  case.  We  therefore  have  that 

W(SHS)  =  0.01^^^  (1.8) 

^  ’  5000 

where  Lx  and  Ly  are  now  in  microns. 

Interferometers  detect  fringe  patterns  as  described  by  Eq.  (1.1).  Here  the 
oversampling  is  required  by  the  smoothing  of  the  measured  data  through  integrating  the 
fringes  by  the  finite-sized  camera  pixels.  This  is  somewhat  similar  to  the  case  of  the  SHS,  so 
we  will  use  a  rough  estimate  of  10  times  oversampling  per  spatial  direction.  On  the  other 
hand,  the  sampling  distance  in  a  phase-shift  interferometer  can  be  as  small  as  the  pixel  size 
on  the  CCD  used  to  get  the  interferometric  data,  which  can  be  as  small  as  5  pm.  We 
therefore  have  that 

SBP  (interferometer)  =  0.01  (1 .9) 

Equations  (1.8)  and  (1.9)  show  that  interferometers  have  about  one  hundred  times  the  SBP  of 
Shack-Hartmann  sensors. 


The  new  type  of  interferometric  sensor  that  we  describe  in  this  work,  the  SFS,  outputs 
data  similar  to  a  phase-shift  shearing  interferometer.  The  first  implementation,  which  uses 
free-space  diffraction  fan-out,  has  an  additional  limitation  on  the  sampling  hole  size  which 
limits  the  sampling  distance  to  about  100  pm  per  sampling  direction  (see  Chapter  2).  Given 
that  this  limit  is  satisfied,  the  diffractive  SFS  can  detect  fields  with  bandwidths  up  to  the 
Nyquist  limit,  which  means  it  has  an  SBP  of 


SfiP  (diffractive  SFS)  = 


L^Ly 

20000 


(1.10) 
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which  is  about  25  times  larger  than  the  SBP(SHS).  The  second  SFS  implementation,  which 
uses  birefringent  fan-out,  does  not  have  the  additional  limitation  and  can  have  an  SBP  equal 
to  that  of  regular  interferometers,  thus  about  100  times  better  than  the  SBP(SHS).  None  of 
the  above  SBP  figures  considers  the  effect  of  noise  and  the  finite  dynamic  range  of  CCD 
systems,  so  they  are  only  rough  estimates  used  for  the  purpose  of  comparing  the  different 
sensor  technologies.  More  research  is  required  to  obtain  accurate  numbers  for  the  relative 
improvements  of  the  information  capacity  of  one  technology  with  respect  to  another. 

1 .5  Overview  of  This  Work 

We  study  two  different  implementations  of  a  new  type  of  wavefront  sensor,  the  SFS. 
Chapter  2  describes  the  SFS  with  fan-out  through  free-space  diffraction.  We  present  the 
concept,  the  design  procedure,  numerical  simulations  of  the  system,  and  experimental  results 
that  validate  the  concept.  Chapter  3  describes  SFS  with  fan-out  through  imaging  the  sampled 
field  through  a  set  of  birefringent  crystals.  We  present  the  concept  and  a  theoretical 
calculation  of  the  design  parameters  as  well  as  the  design  procedure  and  specific  examples  of 
fan-out  generation.  Chapter  4  gives  a  detailed  account  of  the  experimental  verification  of  the 
concepts  described  in  Chapter  3.  We  conclude  in  Chapter  5  with  a  discussion  of  the  results 
of  this  work. 
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5.  DISCUSSION 


We  have  described  a  new  type  of  wavefront  sensor,  the  SFS.  It  is,  to  our  knowledge,  the  first 
high-accuracy,  high-resolution  (high  SBP),  vibration-insensitive,  one-shot  wavefront  sensor. 
It  achieves  high  accuracy  by  using  a  phase-shift  shearing  interferometric  approach  in 
detecting  wavefront  phase  differences.  It  achieves  high  resolution  by  sampling  the  input 
wavefront  and  fanning  out  the  samples  to  the  output  plane  (space  multiplexing).  Not  only 
does  this  provide  one-shot  detection,  but  it  does  it  in  a  common  path  setup,  i.e.,  the  optical 
paths  of  the  field  in  different  parts  of  the  fan-out  pattern  go  through  essentially  the  same 
optics.  This  gives  a  very  compact  and  vibration  insensitive  system. 

We  have  designed  and  tested  two  implementations  of  the  SFS,  one  doing  space 
multiplexing  (fan-out)  through  free-space  diffraction  and  the  other  through  imaging  through 
birefringent  crystals.  In  this  chapter  we  summarize  and  discuss  the  experimental  results,  and 
we  compare  the  two  implementations  based  on  their  fundamental  performance  parameters 
such  as  signal-to-noise  ratio  and  space-bandwidth  product. 

Summary  and  Discussion  of  Results 

In  this  section  we  summarize  the  results  of  numerical  simulations  and  experiments  and 
comment  on  their  relevance. 

Diffractive  SFS 

We  tested  the  consistency  of  the  SFS  method  both  numerically  and  experimentally. 
Numerical  simulations  proved  the  wavefront  sensing  principle  of  this  device.  We  compared 
the  phase  estimation  accuracy  of  the  system  with  that  of  a  Shack-Hartmann  sensor,  through 
numerical  simulations.  Although  its  low  light  throughput  would  give  this  SFS 
implementation  an  SNR  10  times  worse  than  that  of  an  SHS,  this  would  not  be  a  factor  in 
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testing  high  intensity  laser  sources,  for  example.  We  chose  to  test  the  accuracy  without 
factoring  in  any  measurement  noise.  The  numerical  simulations  showed  that  the  input  phase 
differences  could  be  estimated  with  20%  accuracy  up  to  the  Nyquist  limit  given  by  sampling. 
This  is  in  contrast  to  the  SHS,  which  achieved  20%  accuracy  only  at  about  a  third  of  the 
Nyquist  limit  (see  Table  2.1). 

Experimentally,  we  showed  that  the  signal  detected  in  the  phase  pixels  is  proportional 
to  the  cosine  of  the  phase  difference  between  the  two  corresponding  adjacent  sampling 
points.  However,  we  were  not  able  to  calibrate  the  system  in  the  experiments  mainly  because 
of  low  SNR,  low  dynamic  range,  and  low  system  bandwidth.  These  prevented  us  from  using 
input  wavefronts  with  enough  diversity  to  allow  the  calibration  of  the  system. 

The  advantages  of  this  implementation  are  its  simplicity  and  direct  application  to 
testing  pulsed  lasers.  Also,  we  showed  that  a  slightly  different  design,  i.e.,  placing  a  tapered- 
hole  mask  in  front  of  a  CCD  array,  will  result  in  a  very  compact,  cheap,  and  vibration- 
insensitive  wavefront  sensor.  The  disadvantages  of  this  implementation  are  its  low  light 
efficiency  and  small  input  bandwidth  compared  to  other  interferometric  setups  and  to  the 
second  SFS  implementation. 

Birefrinqent  SFS 

The  main  limitations  of  the  previous  SFS  implementation  (low  throughput,  dynamic  range 
and  system  bandwidth)  are  due  to  ffee-space  diffraction  being  an  isotropic  phenomenon 
when  the  generation  of  SFS  characteristic  patterns  requires  an  anisotropic  process.  However, 
similar  patterns,  although  not  with  all  the  required  properties,  can  be  generated  using  array 
generation  techniques  such  as  imaging  through  birefringent  plates  [1],  a  highly  anisotropic 
transformation.  The  idea  is  to  modify  the  PSF  of  the  imaging  system  from  just  one 
bandlimited  jinc  function  to  multiple  copies  of  it  with  additional  phase  differences  between 
these  copies.  To  our  knowledge,  previously  reported  work  in  array  generation  using 
birefringent  elements  did  not  consider  the  control  of  the  phase  difference  between  the  fan-out 
copies  of  the  input. 
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We  showed  that  a  characteristic  pattern  satisfying  the  requirements  of  the  SFS  can  be 
generated  using  birefringent  elements.  We  derived  the  design  equations  with  both  the  ray 
optics  and  the  Fourier  optics  approach.  The  latter  revealed  a  very  important  degree  of 
freedom  in  designing  the  system.  It  consisted  of  using  a  cascaded  imaging  system  and 
placing  the  set  of  birefringent  plates  between  the  second  principal  plane  of  the  first  imaging 
element  and  the  first  principal  plane  of  the  second  imaging  element.  This  allowed  us  to 
magnify  only  the  sampled  field  in  the  first  step  and  both  the  already  magnified  sampled  field 
and  the  pattern  generated  by  the  birefnngent  plates  in  the  second  imaging  step.  As  a  result, 
we  were  able  to  match  the  geometry  of  the  characteristic  pattern  generated  by  a  given  set  of 
plates  with  multiple  sampling  and  receiving  geometries. 

Experimentally,  we  proved  the  validity  of  our  design  equations.  Our  tests  consisted 
of  measuring  the  chirped  wavefront  produced  by  focusing  a  well-collimated  laser  beam  with 
a  high-performance  laser  aplanat.  The  most  important  experimental  result  was  proving  that 
the  system  outputs  complete  shearing  phase-shift  interferometric  data,  i.e.,  shearing 
interferometric  data  along  two  noncollinear  directions  with  multiple  different  phase  shifts  for 
each  shearing  direction. 

Different  shearing  interferometric  data  with  low  cross-talk  was  shown  in  Fig.  4.4  on 
page  76.  The  low  cross-talk  is  obvious  from  the  quality  of  the  interferometric  fringes.  To 
further  prove  it,  we  also  measured  wavefronts  that  were  chirped  only  along  one  direction, 
which  we  obtained  by  focusing  a  well-collimated  laser  beam  with  cylindrical  lenses.  Figures 
5.1  and  5.2  show  the  results  for  two  different  cylindrical  lenses.  The  lenses  were  placed 
against  the  sampling  mask  so  the  curvature  measured  by  the  system  was  approximately  equal 
to  the  focal  length  of  each  lens.  The  measurements  showed,  as  in  the  case  of  spherical 
lenses,  accurate  estimation  of  the  curvature  of  the  input  wavefront.  In  addition,  the  detected 
phase  curvature  in  the  direction  perpendicular  to  chirp  was  zero,  which  means  that  there  was 
little  cross-talk  between  the  output  pixels  measuring  shearing  interferometric  data  along  the 
two  directions,  perpendicular  and  parallel  to  the  direction  of  the  chirp. 
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Modulation  in  the  direction  of  the  chirp  for  a  150  mm  cylindrical  lens 


Figure  0.1 


X  10 


X  10  ' 


Modulation  in  the  direction  perpendicular  to  chirp  for  a  150  mm  cylindrical  lens 


Measurement  of  a  150-mm  cylindrical  lens. 
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Modulation  in  the  direction  of  the  chirp  for  a  1 00  mm  cylindrical  lens 


Peaks  correspond  to:l^  =  97.§7-mm; 


Modulation  in  the  direction  perpendicular  to  chirp  fora  100  mm  cylindrical  lens 


Peak  corresponds  tO-P  = 


mmm 


Figure  0.2  Measurement  of  a  100-mm  cylindrical  lens. 
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The  output  of  the  system  also  provided  diverse  phase  shift  data  according  to  the 
theory  developed  in  Chapter  3.  As  shown  in  Chapter  3,  the  data  in  different  output  pixels 
(that  detect  shear  along  the  same  direction)  can  be  phase-shifted  by  choosing  the  right 
sequence  of  birefringent  plates  (see  Eq.  (3.19)  in  Chapter  3).  In  addition,  the  pixels  in  the 
characteristic  pattern  accumulate  a  n  phase  shift  as  soon  as  the  wavefront  of  their  respective 
fields  passes  through  focus  [2].  However,  the  n  phase  shift  does  not  provide  phase  shift 
diversity.  Only  one  of  the  two  characteristic  patterns  suggested  in  Chapter  3  actually 
provided  phase  shift  diversity.  Unfortunately,  as  discussed  in  Chapter  4,  the  design  of  the 
custom  plate  holders  prevented  us  from  aligning  the  plates  with  accuracy  better  than  5°, 
which  translated  into  20%  variation  of  the  output  fan-out  coefficients  (see  Tables  4.1  and 
4.3).  Each  of  the  output  phase  pixels  that  provided  phase  shift  diversity  (pixels  labeled  7,  1 0, 
2,  and  15  in  Figure  3.5)  was  surrounded  by  four  output  phase  pixels  that  did  not  provide 
phase  shift  diversity.  Cross-talk  and  the  finite  dynamic  range  of  the  data  from  the  CCD  array 
prevented  us  from  obtaining  as  good  a  signal  in  the  phase-shifted  pixels  as  in  the  non-phase- 
shifted  ones.  Figure  0.3  shows  the  interference  signals  from  a  phase-shifted  pixel  compared 
to  the  signal  from  one  of  the  two  pixels  without  phase  shift.  Although  the  signal  in  the 
phase-shifted  pixel  was  strong  enough  to  estimate  the  phase  shift,  it  had  a  much  lower  SNR 
compared  to  the  signal  in  the  non-phase-shifted  pixels  (power  SNR  0.63  compared  to  6.29) 
and  it  was  not  considered  in  the  sequence  of  experimental  tests  described  in  Chapter  4.  In 
fact.  Chapter  4  described  experimental  results  obtained  with  a  different  pattern  which 
provided  better  alignment  but  lacked  phase  diversity  altogether. 

The  fact  that  the  experiments  clearly  confirmed  the  theoretical  calculations  and  that 
phase  shifted  output  was  obtained  (albeit  a  poor  SNR)  leads  us  to  conclude  that  the  designed 
system  is  capable  of  outputting  complete  phase-shifted  interferometric  data.  The  signal  in 
the  phase-shifted  pixels  can  be  improved  by  simply  using  plate  holders  that  allow  a  more 
accurate  alignment  of  the  system  and  by  decreasing  the  cross-talk  to  even  lower  levels 
through  better  imaging  of  the  input  plane  to  the  output. 
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(b)  Signal  in  a  phase-shifted  pixel. 


Figure  0.3 


Output  signals  from  phase  pixels  with  and  without  phase  shift  for 
pattern  (a)  in  Figure  3.5. 
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We  tested  the  system’s  sensitivity  to  vibrations  in  the  environment,  this  being  the 
main  limitation  of  interferometric  systems,  which  prevents  their  more  widespread  use.  We 
caused  vibrations  of  the  optical  table,  which  produced  more  than  one  X  change  (RMS  error) 
in  the  internal  phase  difference  of  a  Mach-Zehnder  interferometer.  By  comparison,  our 
system  showed  a  maximum  of  A,/100  RMS  error  with  some  of  the  pixels  showing  X/lOO  RMS 
error.  Our  system  is,  therefore,  at  least  1 00  times  less  sensitive  to  vibrations  than  a  classical 
system.  This  is  due  mainly  to  its  common-path  design.  Also,  we  measured  the  internal 
phase  error  of  the  system  without  vibrations  and  obtained  an  RMS  of  X/3000,  comparable  to 
that  of  high-performance  phase  shift  interferometric  systems.  It  is  remarkable  that  this 
performance  comes  from  an  interferometric  system  laid  out  on  a  1  -m  path  and  without  any 
shielding  from  air  currents. 

Finally  we  measured  the  accuracy  of  the  phase  estimation  by  measuring  minute  phase 
changes  produced  by  shifting  laterally  the  convergent  wavefront  from  the  laser  aplanat.  We 
measured  an  accuracy  of  X/200,  comparable  to  the  internal  phase  error  of  the  system  under 
environmental  vibration  noise.  This  was  due  to  the  fact  that  moving  the  input  beam  caused 
the  speckle  pattern  on  the  CCD  to  change  in  a  manner  similar  to  the  case  when  the  system 
was  subjected  to  environmental  noise.  Speckle  and  multiple  interference  noise  were  found  to 
be  the  main  noise  sources  in  the  system.  This  was  shown  by  a  decrease  in  noise  of  only  50% 
in  the  K  parameters  for  the  no-vibration  case  compared  to  the  case  with  vibration  noise. 
Further,  immediate  improvements  of  the  system  by  making  it  even  more  compact,  reducing 
the  number  of  reflections  inside  the  set  of  plates,  and  using  a  lower  coherence  laser  source 
can  minimize  the  speckle  and  multiple-interference  noise.  Thus,  even  better  accuracy  can  be 
obtained. 

Fundamental  Parameters  and  Limitations 

In  this  section  we  discuss  some  of  the  fundamental  characteristics/limitations  of  the  SFS.  We 
compare  the  two  implementations  and  show  that  imaging  the  input  plane  to  the  output 
improves  the  system  dramatically. 
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>  Throughput 

The  throughput  is  in  turn  given  by 


=  X 


2  X 


Q 


(1.11) 


where  Fr  is  the  sampling  fill  ratio,  NAsampimg  is  the  sampling  numerical  aperture  of  the 
system,  i.e.,  half  of  the  angle  subtended  by  the  detector  element  as  viewed  from  the  sampling 
plane,  and  n  is  the  angular  bandwidth  of  the  sampled  field.  Fourier  optics  shows  that  Q  is 
given  by  2A,/a. 


>  Fill  ratio 


The  fill  ratio  is  given  by  {ath)^,  with  a  being  the  sampling  hole  size  and  h  being  the  sampling 
period.  For  the  diffractive  SFS,  the  fill  ratio  was  given  by  the  limit  when  the  output  field 
could  not  be  described  in  the  chosen  manner,  as  a  superposition  of  receiver  patterns,  with 
coefficients  being  the  complex  field  at  the  sampling  points.  It  was  found  to  be  approximately 
1/100.  For  the  imaging  SFS  (birefnngent  fan-out),  the  fill  ratio  is  that  of  a  regular  shearing 
interferometer,  such  as  a  Mach-Zehnder.  We  have  obtained  good  contrast  fringes  (see 
figures  in  Chapter  4)  for  an  input  wavefront  with  a  radius  of  curvature  of  1 80  mm,  sampled 
approximately  4  mm  off  axis,  i.e.,  having  an  equivalent  local  spatial  frequency  of  1/90X 
(equivalent  Nyquist  sampling  period  of  45X).  The  sampling  hole  size  was  approximately 
15A.,  giving  a  fill  ratio  of  1/9,  1 1  times  better  than  that  of  the  diffractive  SFS. 

>  Sampling  numerical  aperture 


The  sampling  numerical  aperture  of  the  diffractive  SFS  is  given  by  IJd,  where  Id  is  the 
dimension  of  the  detector  element  and  d  is  the  distance  to  it.  The  size  of  the  detector  element 
was  4  pm  and  the  distance  to  it  was  1400  pm,  thus  giving  NAsampimg  for  the  diffractive  SFS  to 
be  1/700.  In  the  case  of  the  imaging  SFS,  the  sampling  numerical  aperture  is  actually  the 
numerical  aperture  of  the  imaging  system  from  the  sampling  plane  to  the  output  plane.  The 
exact  number  would  be  obtained  from  ray  tracing  through  the  set  of  lenses.  We  used 
multielement  commercial  camera  lenses  and  could  not  obtain  designs  for  all  of  them, 
preventing  us  from  performing  the  ray  tracing.  For  the  purpose  of  this  calculation  we  chose 
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to  underestimate  this  parameter  at  0.1,  which  is  also  consistent  with  our  accurate  imaging  of 
the  lO-pm  sampling  holes  through  the  system.  Thus  we  obtained  a  70-fold  improvement  by 
imaging  the  sampling  plane  to  the  output. 

>  Sampling  period 

The  size  of  the  sampling  period  is  limited,  in  the  case  of  the  diffractive  SFS,  by  the  fill  ratio 
and  the  sampling  hole  size.  Sampling  hole  sizes  less  th^m  5  pm  will  cause  the  sampled  field 
to  depend  on  the  incident  field  via  a  vector  diffraction  model,  not  considered  in  our  approach. 
In  order  to  avoid  this,  the  sampling  period  needs  to  be  bigger  than  approximately  50  pm  and 
the  hole  size  bigger  than  5  pm.  In  the  case  of  the  imaging  SFS,  using  the  same  sampling  hole 
size  (5  pm)  but  the  1/3  ratio  of  the  size  of  the  hole  to  the  sampling  period,  gives  a  minimum 
sampling  period  of  approximately  1 5  pm. 

>  Space  bandwidth  product 


The  SBP  is  given  by 

W  =  (1.12) 

Ah,hy 


For  equal  sampling  hole  sizes  and  the  same  input  apertures,  the  imaging  SFS  has  9  times  the 
SBP  of  the  diffractive  SFS,  due  to  the  higher  fill  ratio  (the  sampling  period  can  be  three  times 
smaller). 


>  SNR 


The  most  important  parameter  is  the  SNR  of  the  data.  Neglecting  the  speckle  and  multiple 
interference  noise,  it  is  given  by 


IdQEGT 


(1.13) 


where  S  is  the  total  signal  and  N  is  the  total  noise  in  the  measurements.  Id  is  the  flux  of 
photons  incident  on  each  detector  element,  QE  is  the  quantum  efficiency  of  the  device,  G  is 
the  pre-amplifier  gain,  T  is  the  integration  time.  Nr  is  the  read-out  noise.  No  is  the  dark 
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charge  noise,  and  Ns  is  the  shot  noise.  If  the  read-out  and  the  dark  current  noise  terms  are 
neglected  (typical  for  light  saturated  applications)  the  SNR  becomes 

SNR=  —  =  ^  =  Gyjl,  QE  T  (1.14) 

N  ^I-QET  ^ 

The  SNR  is  therefore  increasing  as  the  square  root  of  the  photon  flux  reaching  each  detector 
element.  The  flux  reaching  each  detector  element  is  equal  to  Tr  x  //„,  where  Tr  is  the 
throughput  and  Ii„  is  the  input  flux  of  photons  reaching  each  sampling  period.  For  the  same 
input  flux  per  sampling  period  the  ratio  of  the  SNRs  is  given  hy  the  ratio  of  the  throughputs 
of  the  two  sensor  implementations.  By  substituting  the  fill  ratio  and  the  sampled  field 
bandwidth  in  Eq  (1.1 1)  we  obtain  that 

h'^  A 


The  ratio  of  the  throughputs  of  the  two  sensors  for  the  S2une  sampling  period  is  thus  given  by 


(imaging  SFS) 
Tf.  (diffractive  SFS) 


^imaging 
^  ^diffractive 


y 


^^sampling ;  imaging 
^■^samplingidiffractive 


(1.16) 


The  first  ratio  is  3  while  the  second  is  70,  from  above.  Therefore,  the  ratio  of  the  throughputs 
is  1890.  Using  Eq.  (1.14),  this  gives  44  times  improvement  in  the  SNR. 
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Wave-front  sensing  with  a  sampling  field  sensor 


Remy  Tumbar,  Ronald  A.  Stack,  and  David  J.  Brady 


We  present  a  new  type  of  optical  wave-front  sensor:  the  sampling  field  sensor  (SFS).  The  SFS  attempts 
to  solve  the  problem  of  real-time  optical  phase  detection.  It  has  a  high  space-bandwidth  product  and  can 
be  made  compact  and  vibration  insensitive*  We  describe  a  particular  implementation  of  this  sensor  and 
compare  it,  through  numerical  simulations,  with  a  more  mature  technique  based  on  the  Shack- 
Hartmann  wave-front  sensor.  We  also  present  experimental  results  for  SFS  phase  estimation.  Fi¬ 
nally,  we  discuss  the  advantages  and  drawbacks  of  this  SFS  implementation  and  suggest  alternative 
implementations.  ©  2000  Optical  Society  of  America 
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1.  Introduction 

Wave-front  sensing  is  used  to  detect  the  amplitude 
and  phase  of  the  field  for  optical  testing  and  hybrid 
optical  imaging  systems.^  Optical  testing  applica¬ 
tions  include  surface  reconstruction  techniques  for 
eye  surgery, 2  lens  testing, ^  and  diffractive  optical  el¬ 
ement  characterization.^  Hybrid  imaging  systems 
use  amplitude  and  phase  measurements  for  postde¬ 
tection  or  predetection  processing.  Adaptive  optical 
systems^  use  predetection  processing  to  improve  im¬ 
age  quality  by  removing  wave-front  distortions.  De- 
convolution^  and  tomographic  reconstruction® 
systems  use  postdetection  processing  for  digital  ob¬ 
ject  reconstruction. 

Wave-front  sensors  include  interferometric  and 
noninterferometric  systems.*^  Shearing  interferom¬ 
eters,  point-diffraction  interferometers,®  and  the 
pseudo-phase-conjugate  interferometer®  are  a  few  ex¬ 
amples  of  interferometric  wave-front  sensors.  Non¬ 
interferometric  wave-front  sensors  include  the 
Shack-Hartmann  sensor  (SHS)i®  and  the  curvature 
sensor^  1  with  the  SHS  being  the  most  commonly  used 
wave-front  sensor.  The  SHS  is  constructed  by  one 
mounting  an  array  of  lenses  in  front  of  an  array  of 
detectors.  The  detectors  determine  the  position  of 
the  focal  spot  intensity  centroid  of  each  lens.  The  set 


The  authors  are  with  the  Beckman  Institute  for  Advanced  Sci¬ 
ence  and  Technology,  University  of  Illinois  at  Urbana-Champaign, 
Urbana,  Illinois  61801.  D.  J.  Brady’s  e-mail  address  is 
dbrady@uiuc,edu. 

Received  27  May  1999;  revised  manuscript  received  23  Septem¬ 
ber  1999. 

0003-6935/00/010072-13$15.00/0 

©  2000  Optical  Society  of  America 


of  centroid  positions  for  a  normally  incident  plane 
wave  serves  as  a  zero  reference.  The  offsets  be¬ 
tween  the  detected  centroids  for  an  arbitrary  input 
wave  front  and  the  zero  reference  positions  provide 
measures  of  the  average  wave-front  tilt  coefficients 
over  each  lens  subaperture.  The  input  wave  front  is 
then  reconstructed  with  data  reduction  techniques  by 
use  of  these  average  tilt  measurements. 

In  one  technique  we  can  find  the  wave-front  phase 
at  each  sampling  point  (for  example,  the  center  of 
each  lens)  by  considering  that  phase  differences  be¬ 
tween  adjacent  sampling  points  are  given  by  a  linear 
combination  of  the  local  tilt  coefficients.  This  tech¬ 
nique  is  known  as  zonal  reconstruction.  12-14  Zonal 
reconstruction  has  a  low  computational  complexity 
because  it  uses  sparse  matrices  to  connect  the  values 
of  the  input  wave  front  on  the  sampling  grid  to  the 
measurements  taken  by  the  sensor.  However,  when 
the  bandwidth  of  the  input  wave  front  is  large,  the 
higher-order  aberration  coefficients  can  no  longer  be 
neglected.  In  other  words,  the  average  tilt  measure¬ 
ments  are  not  a  good  representation  of  a  high- 
bandwidth  input  field,  and  the  zonal  reconstruction 
method  fails.  In  this  case  one  could  use  a  more  com¬ 
plete  representation  of  the  subaperture  wave  front  in 
terms  of  structure  functionsi®  or  relate  the  average 
tilt  measurements  to  a  better  representation  of  the 
input,  which  is  the  essence  of  modal  reconstruction 
techniques.!^’!®  The  first  approach  needs  more  pro¬ 
cessing  than  the  zonal  reconstruction  method, 
whereas  the  second  one  is  faulted  by  modal  cross 
coupling  or  aliasing.!'^ 

In  this  paper  we  present  a  new  wave-front  sensing 
device,  the  sampling  field  sensor  (SFS).  The  SFS  is 
a  self-referencing  interferometric  wave  front  sensor 
similar,  in  this  respect,  to  a  shearing  interferometer, 
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or  to  a  point'dijBfraction  interferometer.  The  SFS  con¬ 
sists  of  a  sampling  stage  and  a  fan-out  stage.  The 
input  wave  front  is  sampled  with  an  array  of  small 
apertures.  Each  sample  of  the  field  is  fanned  out  to 
multiple  photodetectors  in  the  sensor's  output  plane, 
where  it  overlaps  with  the  field  fanned  out  from  adja¬ 
cent  samples.  The  interference  from  each  pair  of 
samples  is  detected,  with  different  phase  shifts,  at  a  set 
of  points  in  the  output  plane  associated  with  the  pair. 
The  phase  difference  between  the  field  coming  from 
adjacent  samples  is  estimated  by  use  of  techniques 
similar  to  phase-shift  interferometry.  In  this  paper 
we  test  numerically  and  experimentally  a  SFS  design 
in  which  the  sampling  stage  is  a  mask  patterned  with 
holes  and  the  fan-out  stage  is  simply  Fresnel  diffrac¬ 
tion.  We  also  show  how  a  SFS  can  be  built  by  placing 
an  array  of  tapered  sampling  holes  a  small  distance 
in  front  of  a  CCD  array.  This  results  in  a  compact, 
vibration-insensitive  interferometric  sensor.  It  com¬ 
bines  the  sensitivity  of  interferometric  wave-fi^ont 
sensors  with  the  robust,  compact  nature  of  the  nonin- 
terferometric  ones.  In  addition,  we  suggest  alterna¬ 
tive  implementations  of  the  fan-out  stage.  We  use  a 
numerical  simulation  to  show  that  the  SFS  could  sense 
input  fields  with  bandwidths  up  to  the  Nyquist  limit 
using  only  zonal  reconstruction  methods.  This  makes 
the  SFS  a  good  candidate  for  applications  that  require 
detection  of  high  information  content  fields,  i.e.,  fields 
with  a  high  space-bandwidth  product. 

In  Section  2  we  provide  the  SFS  design  equations 
and  the  input  reconstruction  (inversion)  algorithm. 
In  Section  3  we  choose  a  particular  set  of  design 
parameters  and  test  this  particular  design  numeri¬ 
cally  and  experimentally.  We  discuss  the  results  of 
the  tests  and  propose  alternative  designs  for  the  sam¬ 
pling  and  fan-out  stages.  In  Section  4  we  outline  the 
characteristics  of  the  SFS  that  could  help  spread  use 
of  optical  phase  detection  systems  outside  the  labo¬ 
ratory  environment. 

2.  Sampling  Field  Sensor  Design 

A.  General  Principle 

The  principle  behind  the  SFS  can  be  viewed  indepen¬ 
dently  of  the  particular  physical  implementation  of 
its  constitutive  elements.  It  relies  on  the  fact  that  a 
band-limited  function,  such  as  an  optical  field,  can  be 
approximately  represented  over  a  finite  aperture  by  a 
finite  number  of  sample  values.  The  SFS  uses  opti¬ 
cal  elements  to  separate  sample  values  from  the  in¬ 
put  field  and  to  interfere  them  such  that  their  phase 
and  amplitude  can  be  decoded.  In  the  particular 
implementation  we  describe  here  we  sample  the  in¬ 
put  field  using  a  hole  grating  and  then  detect  the 
irradiance  a  specific  distance  away.  This  distance  is 
chosen  to  ensure  that  the  adjacent  far-field  patterns 
from  each  sampling  hole  overlap  partially  at  the 
edges  in  the  detection  plane.  Figure  1(a)  illustrates 
the  concept  by  showing  only  two  sampling  holes  and 
their  partially  overlapping  far-field  diffraction  pat¬ 
terns.  We  processed  multiple  intensity  measure¬ 
ments  in  each  overlap  region  using  an  algorithm 
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Fig.  1.  (a)  SFS  concept,  (b)  Physical  implementation  of  the  SFS. 


similar  to  phase-shifting  interferometry  to  estimate 
the  phase  difference  between  the  two  adjacent  sam¬ 
pling  points.  One  measurement  in  each  nonoverlap 
region  is  enough  to  estimate  the  irradiance  of  the 
corresponding  sampling  point.  We  can  obtain  the 
phase  shifts  required  by  the  phase  estimation  algo¬ 
rithm  by  placing  the  detectors  at  specified  positions 
in  the  output  plane  to  take  advantage  of  the  qua¬ 
dratic  phase  sWft  given  by  the  propagation  in  free 
space.  In  practice,  one  also  includes  spectral  or  spa¬ 
tial  filtering  components  or  other  types  of  focusing  or 
windowing  components  in  the  sensor. 


B.  Design  Procedure 

The  goal  of  the  SFS  is  to  estimate  the  phase  and 
amplitude  of  a  band-limited  field  across  an  input  ap¬ 
erture.  We  consider  an  input  field  fiJ^x,  y)  with 
bandwidth  B.  According  to  the  Whittaker-Shannon 
theorem,^® 

y)  “  2  finish,  nh)smc{x  -  m/i)sinc(y  -  n/i). 

m,n 

(1) 

Equation  (1)  is  valid  under  the  Nyquist  condition 
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If  we  cotild  measure  the  field  directly,  we  could  use 
Eq.  (1)  to  determine  y)  by  measuring  sample 
values.  In  optical  systems,  however,  one  measures 
the  time  average  of  the  intensity  of  the  field  rather 
than  the  field  itself.  In  general,  reconstructing 
y)  from  samples  of  (|/in(^,  y)f)  is  difficult  or  impossi¬ 
ble.  The  idea  of  the  SFS  is  to  use  sampling  and 
linear  transformation  between  the  input  aperture 
and  the  intensity  at  the  detection  plane  to  obtain  an 
invertible  relationship  between  the  detected  inten¬ 
sity  and  the  input  field.  Sampling,  by  use  of  pin¬ 
holes,  for  example,  isolates  the  field  values  finish, 
nh).  Diffraction  or  other  linear  transformations  be¬ 
tween  the  pinholes  and  the  detection  plane  maps  the 
field  samples  onto  new  distributions.  The  field  at 
the  detection  plane  is  then  represented  as 


^receiverU',y')  =  2  nh)r{x'  ~  mh\y  “  fill'), 

m,n 

(3) 

where  r{x,  y)  are  called  receiver  pattern  fimctions. 
We  seek  to  design  the  receiver  pattern  r(x,  y)  such 
that  the  field  values  nh),  and  thus /in{x,y),  can 

be  estimated  from  samples  of  <|/^receiver(^j  y)r)-  Prac¬ 
tical  difficulties  that  one  confronts  in  implementing 
this  design  include  the  fact  that  Eq.  (3)  is  not  quite 
accurate  because  it  is  not  possible  to  isolate 
nh)  exactly  with  finite  pinholes  and  the  fact  that 
reconstruction  from  <|/receiver(^»  y)^)  will  be  sensitive 
to  noise.  Discussion  of  these  practicalities  is  de¬ 
ferred  to  Section  3  because  in  this  section  we  are  more 
concerned  with  the  physical  implementation  of  the 
SFS  design  concept. 

Figure  1(b)  shows  a  more  detailed  diagram  of  the 
SFS.  In  the  input  plane  of  the  SFS  there  is  a  sam¬ 
pling  mask  consisting  of  small  (compared  to  the  sam¬ 
pling  distance)  clear  regions  or  holes  on  an  otherwise 
opaque  substrate.  Each  hole  is  circular  with  diam¬ 
eter  a  and  is  placed  on  a  rectangular  grid  with  spac¬ 
ing  h  in  both  directions.  This  is  the  sampling  stage 
of  the  device.  The  fan-out  stage  consists  of  a  4/*  sys¬ 
tem  with  its  object  plane  placed  a  distance  d  behind 
the  sampling  mask.  The  Fourier  plane  of  the  4/ sys¬ 
tem  has  a  low-pass  filter  with  band  limit  The 
intensity  in  the  output  field  of  the  Af  system  is  de¬ 
tected  with  an  array  of  photodetectors,  like  a  CCD 
camera.  The  output  plane  of  the  4/*  system  is  the 
receiver  plane  shown  in  Fig.  1(b). 

We  now  show  how  one  can  design  the  system  de¬ 
scribed  above  to  implement  controlled  fan-out  from 
the  sampling  plane  to  the  receiver  plane  and  how  to 
use  intensities  measured  by  the  photodetectors  in  the 
receiver  plane  to  estimate  the  amplitude  and  phase  of 
the  input  field.  The  idea  is  to  choose  the  parameters 
a,d,h,  and  such  that  the  field  in  the  receiver  plane 
of  the  4f  system  can  be  considered  to  have  the  func¬ 
tional  form  of  Eq.  (3)  with  an  appropriate  receiver 
pattern.  We  consider  a  receiver  pattern  to  be  appro¬ 
priate  if  Eq.  (3)  can  be  efficiently  and  accurately  in¬ 
verted  to  estimate  the  field  samples.  To  achieve  this 


goal,  we  design  the  SFS  to  have  receiver  patterns 
such  that 


>  0,  for  0  <  \x'\,  |y'|  <h'  -  e/2 
=  0,  for  |x'l,  |y'|  >h'  -  e/2 


Equation  (4)  implies  that  only  two  adjacent  receiver 
pattern  functions  overlap  at  any  point  in  the  output 
plane.  Also,  there  is  a  region  in  each  receiver  pat¬ 
tern  of  approximate  size  e  where  there  is  no  overlap. 
It  is  clear  that  the  representation  of  the  receiver  field 
given  by  Eqs.  (3)  and  (4)  is  an  approximation.  Be¬ 
cause  its  output  is  band  limited  it  caimot  be  space 
limited  as  suggested  by  Eq.  (4).  However,  if  the  in¬ 
tensity  in  the  receiver  pattern  fiinction  outside  the 
specified  support  region  is  small  enough,  we  can  con¬ 
sider  it  to  be  zero.  Therefore  we  specify  the  design 
parameters  a,  d,  h,  and  such  that  the  error  in  Eq. 
(3)  is  negligible  when  r(x,  y)  is  of  finite  support. 

The  design  equations  are  foxmd  by  one  considering 
the  diffraction  of  the  field  scattered  by  the  sampling 
mask  using  Rirchhoff  boundary  conditions  (KBC) 
with  a  propagation  kernel  derived  from  a  Fourier 
optics  approach.  Assuming  the  four  design  param¬ 
eters  have  been  found,  we  can  describe  the  output  of 
the  system,  to  a  good  approximation,  by  Eq.  (3).  The 
next  step  is  to  then  specify  the  positions  of  the  pho¬ 
todetectors  in  the  receiver  plane.  We  assume  that, 
in  general,  the  placement  of  photodetectors  or  re¬ 
ceiver  pixels  in  the  receiver  plane  can  be  arbitrary 
and  is  not  limited  to  a  regular  square  grid.  There¬ 
fore  these  positions  are  additional  design  parame¬ 
ters.  The  final  step  is  to  specify  an  inversion 
algorithm  to  estimate  the  amplitude  and  phase  of  the 
input  field  at  the  sampling  points  based  on  the  inten¬ 
sity  measurements  at  the  receiver  pixels.  We  show 
in  this  paper  that  the  measured  intensity  values  de¬ 
pend  on  the  amplitude  and  phase  of  the  input  field  at 
each  sampling  point  by  way  of  a  transformation  that 
is  parameterized  by  a  set  of  constants.  The  con¬ 
stants  depend  on  the  construction  of  the  SFS,  espe¬ 
cially  the  position  of  the  receiver  pixels  (x  ,  y^).  We 
choose  these  positions  such  that  the  resulting  set  of 
parameters  will  give  a  robust  inversion  of  the  data  to 
reconstruct  the  input. 

To  specify  the  design  parameters  a,  d,  h,  and  (x^, 
y  J  we  must  consider  the  physical  implementation  of 
the  SFS  in  more  detail.  Assuming  KBC,  the  field 
right  after  the  sampling  mask  fsampiedC^^  y)  is  given  by 


Sampled ( y)  /*in(^>  y)  5)  j^^y  hK) 


=  2  nh)^{x  -  mh,  y  -  nh),  (5) 


where  the  function  SQ{x,y)  describes  the  transmission 
through  one  period  of  the  mask  and  is  given  by 


Soix)  = 


a 


1  for  |x|,  |y|  <  - 
0  for  ^<14  |y|<^ 


(6) 
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The  function  {p{x,  y)  is 

<p(x,  y)  =  y)  2)  So(^  -jh,y-  kh),  (7) 
JM 

where  3^)  is  sinc(x,  y).  The  receiver  field  is  the 
sampled  field  convolved  with  the  free-space  propaga- 
tion  Fresnel  kernel,  followed  by  the  convolution  with 
the  point-spread  function  of  the  band-limited  4/ sys¬ 
tem.  Thus  the  receiver  field  is  represented  by 


^eceiver(^>  y)  [  ^ampledC*^)  y)  ^  y)]  ^  y)> 

(8) 

where  0  is  the  two-dimensional  convolution  operator, 
y)  is  the  Fresnel  kernel  representing  propaga¬ 
tion  over  distance  d,  and  h^f{x,  y)  is  the  point-spread 
function  of  the  4/  system.  Note  that  the  consider¬ 
ation  of  the  second  convolution  operation  in  Eq.  (8) 
neglects  vignetting.^^  We  can  also  write  Eq.  (8)  us¬ 
ing  a  property  of  the  Fourier  transform  as 


/receiver(^>  y)  FT  [•Fganipled(^j  ^)J 

“FT  ^[Fsampled(z^,  ^)]>  (9) 

where  FT“^  is  the  inverse  Fourier-transform  opera¬ 
tor,  Hd  is  the  Fourier  transform  of  hd,  is  the 
Fourier  transform  of  and  i/sFS  i®  transfer 
function  of  the  SFS,  i.e.,  the  Fourier  transform  of  the 
point-spread  function  of  the  SFS.  If  we  assume  that 
the  Af  system  has  no  aberrations  and  that  it  imple¬ 
ments  a  low-pass  filter  in  its  Fourier  plane,  will 
be  a  low-pass  filter  also.  Therefore  HgFs  is  th®  Fourier 
transform  of  the  Fresnel  kernel  windowed  by  the  low- 
pass  filter  in  the  Fourier  plane  of  the  4/*  system.  Us¬ 
ing  Eqs.  (5)-(8)  we  find  that  the  field  in  the  receiver 
plane  is 


/receiver(^j  y)  /sampledC-^j  y)  ^  ^SFS 

=  2  finish,  nh)r{x  -  mh\  y  -  nh'), 

m,n 

(10) 

where  “  FT  the  receiver  pattern 

function  is  given  by 


The  limited  support  requirement  in  Eq.  (4)  cannot  be 
satisfied,  in  general,  for  the  case  in  which  KBC  apply 
and  /igFs  is  band  limited  because  both  the  factor  in 
the  square  brackets  in  Eq.  (12)  as  well  as  /igFs  h^ve 
unlimited  support.  However,  if  the  size  of  the  sam¬ 
pling  hole  is  small  compared  to  the  sampling  dis¬ 
tance,  the  contributions  from  the  zero  crossings  of 
^{Xy  y)  can  be  neglected.  This  allows  the  factor  in 
the  square  brackets  in  Eq.  (12)  to  satisfy  the  require¬ 
ment  of  limited  support.  The  size  of  the  sampling 
hole  can  be  found  by  one  tr3dng  different  values  until 
the  SFS  wave-front  reconstruction  error  becomes  ap¬ 
propriately  small,  i.e.,  when  the  expansion  in  Eq.  (3) 
is  still  valid  with  the  limited  support  requirement  of 
Eq.  (4)  satisfied.  Assuming  that  we  can  neglect  the 
terms  in  the  sum  that  multiply  the  regions  around 
the  zero  crossings  of  4i(jc,  y)  and  allow  ^\f{x,  y)  =  1  over 
the  sampling  hole  region  in  the  main  lobe  of  il;(jc,  y), 
we  use  Eq.  (12)  and  the  definition  of  /igps  to  obtain 

Hxy  y)  =  [y^fixy  y)soiXy  y)]  0  h^ixy  y)  0  h^f{Xy  y) 

-  SoiXy  y)  0  h^fixy  y)  0  h^ix,  y) .  ( 13) 

By  grouping  the  two  factors  of  the  first  convolution  in 
So'ix:,  y)  and  using  the  Fresnel  diffraction  kemeB^  for 
hd,  we  obtain 


r{Xy  y)  =  exp 


.(^c^+y^) 


X 


\d 


FT  So'(^,  Vi)  exp 


\d 


X  y 

“xrf 


(14) 


where  u  and  v  are  the  spatial  frequencies  where  the 
Fourier  transform  is  evaluated.  Thus,  for  a  sam¬ 
pling  hole  of  size  a  much  smaller  than  h  and  rf,  the 
receiver  pattern  function  is  approximately  given  by 
the  Fourier  transform  of  the  band-limited  sampling 
hole  So'(^,  y)  with  an  additional  quadratic  phase  fac¬ 
tor.  We  can  pick  the  windowing  function  in  the  Fou¬ 
rier  plane  of  the  Af  system  such  that  it  reduces  the 
ripples  of /igFs  outside  of  the  specified  support  region. 
If  we  pick  an  appropriate  windowing  function  (Han¬ 
ning  or  Hamming)  with  a  band  limit 


r{x  -  mh'y  y  —  nh')  =  ip{x  —  mh'y  y  —  nh') 

^hsFsix,y)  (11) 


(15) 


over  all  integers  m  and  n.  The  parameter  h'  is  the 
distance  between  the  centers  of  adjacent  receiver  pat¬ 
terns  in  the  receiver  plane.  We  can  assume,  without 
loss  of  generality,  lx  magnification  for  the  4/ system. 
Thus  h'  is  equal  to  hy  and  the  coordinates  in  the 
receiver  plane  are  the  same  as  in  the  sampling  plane. 
Because  the  sampling  mask  is  periodic  with  period  h, 
it  follows  that  r{x-mhy  y-nh)  —  r(x,  y)  over  all  integers 
m  and  n .  Substituting  Eq.  (7)  into  Eq.  (11)  yields  the 
receiver  pattern  function 


r{x,  y) 


2  so(^  -jh,y 


®  hsFs(x,  y). 


(12) 


then  r{xy  y)  will  be  given  only  by  the  main  lobe  of  a 
sine  function. 

In  Section  3. A  we  give  more  details  about  the 
numerical  simulations  of  the  SFS  wave-front  recon¬ 
struction.  Among  other  tests,  we  considered  a  sine- 
shaped  incident  field  diffracted  by  a  mask  in  which 
we  sampled  the  input  function  at  the  central  lobe  and 
adjacent  zero  crossings.  This  gives  an  output  field 
rixy  y)  that  consists  of  a  set  of  diffraction  patches 
arranged  on  a  grid  with  spacing  h.  We  observed 
that  a  ratio  h/a  of  10  makes  the  ratio  of  the  intensi¬ 
ties  in  the  patches  coming  from  the  zero  crossings  and 
the  central  patch  to  be  of  the  order  of  lO”"^.  This 
ratio  increases  with  our  increasing  the  size  of  the  hole 
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compared  to  the  sampling  distance.  Also,  the  case 
with  =  110,  a  =  10,  X  =  0.633,  d  =  1400  fim  and 
a  Hanning  window  with  =  0.1  {xm"^  gave  a  20% 
mean  reconstruction  error  at  maximum  input  band¬ 
width.  Considering  this  to  be  satisfactory,  we  ob¬ 
tained  a  design  equation  giving  a  to  be  roughly 


h 


(16) 


less  than  e  or  2h(l-q)  in  each  direction.  Both  types 
of  phase  pixels  are  placed  in  the  overlap  regions.  All 
three  classes  of  receiver  pixels  are  placed  in  the  re¬ 
ceiver  plane  in  a  periodic  structure.  Each  receiver 
cell  will  contain  nine  receiver  pixels:  one  amplitude 
pixel,  four  phase  1  pixels,  and  four  phase  2  pixels. 
Figure  2  shows  three  adjacent,  overlapping  receiver 
cells.  The  signal  in  the  amplitude  pixel  of  receiver 
cell  (m,  n)  is  given  by 


Enforcing  the  limited  support  of  the  receiver  pattern 
fimctions  in  the  context  of  using  KBC  to  model  the 
diffraction  from  the  sampling  mask  severely  limits 
the  ratio  a/h.  The  main  drawback  is  to  severely 
limit  the  amount  of  light  transmitted  by  the  system. 
We  also  note  that  the  model  presented  here  is  not 
valid  for  h  less  than  approximately  70  |xm  because 
this  would  require  a  less  than  7  ixm  or  approximately 
10  wavelengths,  which  in  turn  makes  the  KBC  in¬ 
valid.  We  can  derive  the  equation  that  gives  the 
propagation  distance  d  from  relation  (14)  by  noting 
that  Sq{x,  y)  is  band  limited  to  and  that  the  sup¬ 
port  of  r(jc,  y)  is  required  to  be  inside  the  square  \x\  < 
qh  and  \y\  <  qh  with  ^  <  1.  On  the  other  hand,  d 
needs  to  be  large  enough  to  ensure  the  overlap  of 
adjacent  patterns,  i.e.,  |r(:ic,y)|  has  to  be  nonzero  for  \x\ 
>  h/2  and  \y\  >  h/2.  Thus  we  obtain 


h  qh 

- — . 

2XB,.  XB^ 


(17) 


To  summarize,  Eqs.  (2)  and  (15),  approximation  (16), 
and  inequality  (17)  are  the  design  equations  that  give 
the  parameters  h,  B^,  a,  and  d,  respectively. 

Next  we  consider  the  equations  giving  the  positions 
of  the  receiver  pixels,  but  first  we  need  to  model  their 
intensity  measurements.  We  specify  the  detection 
area  of  each  receiver  pixel  by  the  function  yp), 

where  the  individual  receiver  pixel  coordinates  are 
denoted  by  x^  and  y^  with  respect  to  the  center  of  the 
corresponding  receiver  pattern  r{x4h,  y-jh),  which  is 
centered  at  (ihjh).  The  function  (TijiXp,  y^)  is  unity 
over  the  area  of  the  detector  centered  at  (Xp,  yp)  in 
receiver  cell  (i,  j)  and  zero  elsewhere.  The  receiver 
cell  (i,  j)  is  the  region  of  support  for  r{x-ih,  y-jh). 
Thus  the  signal  measured  by  the  photodetector  at  the 
receiver  pixel  cr^ j(Xp,  yp)  is  proportional  to 


F/j(xp,  y^) 


I  A 

J  I 


yp) 


2  fmimh,  nh)r{x”  -  mh'. 


y"  -  nh') 


dx"dy', 


(18) 


r,„.„(0  ,0)  =  \fjmh 


,nh)f  II 


|r(jc"  -  mh', 


0) 

y"  -  n/i')Pdx"dy". 

Equation  (19)  can  be  written  in  the  form 

WO,  0)  =  \Umh,nh)\^K,\ 


(19) 


(20) 


where  is  a  real  number  that  is  independent  of  the 
input,  depending  only  on  the  construction  of  the  SFS. 
The  signal  measured  by  the  phase  pixels  differs  from 
Eq.  (19)  in  that  the  overlap  of  two  adjacent  (horizon¬ 
tally  or  vertically)  receiver  patterns  needs  to  be  con¬ 
sidered.  Thus  the  signal  for  a  phase-type  receiver 
pixel  in  the  receiver  cell  (m,  n)  is  found  by  one  keep¬ 
ing  two  horizontally  (vertically)  adjacent  terms  from 
Eq.  (18).  This  results  in 


^m,n{xpi>yp^  =  \fJrnh,  nh)f 


II 


IKjc"  -  mh'. 


^m,nixpiypd 

y"  -  nh')fAx"dy"  +  l/in[(?ra  +  l)h,  ra/i]| 


^  II 


|r[a:"  -  (m  + 


y"  -  nh']\^dx"dy'' 


+  2  Re{fij,{mh,  nh)*fi„[{m  +  l)h,  nh]} 


X 


I  A 

J  I 


ReirCjc"  -  mh'. 


I’mMmj'Pi) 

y"  -  nh')*r[x"  -  (m  +  l)h\ 

y"  ~  nh']}dx"dy\ 


(21) 


where  (xp^,  yp^)  is  the  position  of  each  phase  pixel  of 
type  i  =  1,  2  in  the  x  direction  (note  that  the  symbol 
*  represents  complex  conjugate).  Equation  (21)  can 
be  rewritten  as 


where  at  most  two  terms  of  the  sum  interfere  at  each 
point  according  to  the  finite  support  requirement  of 
Eq.  (4).  We  consider  three  classes  of  receiver  pixels: 
amplitude  pixels,  phase  1  pixels,  and  phase  2  pixels. 
The  amplitude  pixels  are  placed  in  the  nonoverlap 
regions  at  the  center  of  each  receiver  pattern. 
Therefore  the  size  of  the  amplitude  pixels  needs  to  be 


=  jfi„(mh,  nh)l%i  +  +  1) 

X  h,  nh]fK^  +  Kpi\f,n{mh,  nh)\ 

^  |/in[(^  +  1)^)  7l/l]|cOS 
X  {^{mh,  nh)  —  4>[(m  +  l)h,  nh]  -  aj, 

(22) 


76  APPLIED  OPTICS  /  Vol.  39,  No.  1  /  1  January  2000 


Legend 

S  Amplitude  pixels 


Wh  Fiiase  I  pixels 
B  Pltase  2  pixels 

•-*  Receiver  cell 
boundar)' 

Fig.  2.  Layout  of  overlapping  adjacent  receiver  patterns.  A  re¬ 
ceiver  cell  is  the  area  covered  by  the  corresponding  receiver  pat¬ 
tern. 


where  4)(x,  y)  is  the  phase  of  the  complex  wave  front 
y)'  Equation  (22)  also  defines  four  other  con¬ 
stants,  Kii,  jK'2/,  Kpi,  and  for  each  phase  pixel  of 
type  i  =  1,  2.  Thus  there  are  a  total  of  nine  con¬ 
stants  that  define  the  output  of  the  SFS  system  in- 
dependently  of  the  input,  as  long  as  the  input  is  band 
limited  and  Eq.  (3)  with  the  restriction  of  Eq.  (4) 
remains  valid.  These  constants  are  Kp^,  Kp2, 
^i2>  ^21?  oti,  and  ttg.  They  are  enumerated 
as  follows: 


K  = 


Kpr 


If 


L<^o,o(o,  0) 


IJ 


1/2 


rix",y"y*r{x"  -  h,y'')dx"dy'’ 


laofiixpi.ypi) 

=  1,2, 


fori 


a,  =  -Z. 


=  1,  2, 


1! 


r(x",y")*r(x"  -  h,y’')dx''dy'' 


VO,  ,  3'P/) 


fori 


Ku  =  JJ*  |r(:x:",  j")Pda:"d>'"  with  i  =  1,  2, 


‘T0,0(A:ft,3'Pi) 


K2i  =  j|  \r(x’'-h',  for  i  =  1,  2. 


‘^0,  0(  xpi,  ypi) 


(23) 


Extending  Eqs.  (21)-(23)  to  the  y  direction  is  just  a 
matter  of  considering  the  adjacency  of  the  receiver 


patterns  in  that  direction  and  calculating  the  new 
constants.  In  certain  cases,  circularly  symmetric  or 
separable  receiver  patterns,  the  pixel  assignment  can 
be  done  so  that  the  K  parameters  are  the  same  in  both 
Cartesian  directions.  By  changing  the  values  of  m 
and  n,  one  can  relate  the  values  of  the  field  at  all  the 
points  {mh,  nh)  to  the  signals  detected  in  the  receiver 
pixels  by  Eqs.  (20),  (22),  and  (23).  Equations  (20) 
and  (22)  constitute  what  we  call  the  SFS  representa¬ 
tion  of  the  input  field,  whereas  Eqs.  (23)  give  the 
physical  meaning  of  its  parameters.  The  inversion 
algorithm  is  based  on  the  SFS  representation,  pa¬ 
rameterized  by  the  K  parameters  and  the  assumption 
that  ttj  2  are  different.  We  directly  estimate  the  am¬ 
plitude  at  each  sampling  point  from  the  intensity 
measurement  at  the  amplitude  pixel  for  each  receiver 
cell  using  Eq.  (20)  with 


\f^^“{ih,jh)\  =  .  (24) 

The  phase  difference  between  adjacent  sampling 
points  is  found  with  a  procedure  similar  to  phase- 
shift  interferometry.^o  The  two  intensities  mea¬ 
sured  by  both  phase  pixels  of  a  receiver  cell  may  be 
considered  as  two  frames  with  different  phase  shifts 
in  a  phase-shift  phase  estimation  algorithm.  The 
difference  is  that  the  average  intensity  and  the  fringe 
modulation  factor  are  changing  from  one  phase  pixel 
to  another,  making  classical  phase-shift  techniques 
unusable.  The  alternative  that  we  propose  is  to 
solve  the  system  of  equations  formed  by  Eq.  (22)  with 
i  =  1,  2  for  the  quantities 

l/in[(^  +  l)h,  nA]||/in(ni/i,  nh)\KpiKp2  sin{(p(m/i,  nh) 

-  (p[(m  +  \)h,  n/i]}sin(ai  -  ag)  =  DxKp2  cos(a2) 

-  DzKpT^  cos(ai) 

l^in[(o^  +  l)h,  nh]\\fip{mh,  nh)\Kp^Kp2  cos{<f{mh,  nh) 

-  (p[(m  -I-  1)A,  nh]}sm(ai  -  =  -DiKp2  sin(a2) 

+  D2Kpi  sin(ai),  (25) 

where 

■Di  =  r„_n(xpi,ypi)  -  Kiilfipimh,  nh)f  —  K2\\fJi{m 
-I-  l)/i,  nh'lf, 

^2  ~  l'mytixp2,  yp^  ~  nh)^  —  K2^fjJiiTn 

+  l)h,  nh]f.  (26) 

The  values  of  and  D2  can  be  estimated  by  use  of 
the  values  of  the  field  amplitudes  calculated  with  Eq. 
(20).  Finally,  we  find  the  phase  difference  by  talcing 
the  inverse  tangent  of  the  ratio  of  the  two  quantities 
in  Eqs.  (25).  The  result  is  extended  over  the  (-ir,  ir) 
interval  by  use  of  the  signs  of  the  numerator  and 
denominator.  To  summarize,  the  amplitude  and 
phase  of  the  input  field  are  given  by  the  following 
inversion  algorithm: 
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^estimated 

9 


nh)\  = 


{mh,  nh)  -  +  l)h,  nh]  =  tan 


=  r„,„(:cp„  ypi)  -  iCn|/’in“"'(/n/i,  nh)f  - 

x|/;n““[(^  +  l)ft,n/i]|', 

D2  =  r„,„(^P2,3'p2)  -  nh)f  -  K22 

X  +  1)^,  nhf, 

DiKp2  cos(a2)  -  £>2-Kpi  cos(ai) 


-1 


[-DiKp2  sin(a2)  +  sin(ai)J  ’ 


(27) 


The  phase  map  of  the  input  wave  front  can  be  gen¬ 
erated  from  these  phase  differences  by  use  of  well- 
known  techniques  from  shearing  interferometry. 
The  last  step  of  the  derivation  in  this  subsection  is  to 
give  the  rule  for  choosing  the  positions  of  the  phase 
pixels  (xpi,  ypi)  and  {xp2,  yp2)^  This  has  to  be  done 
such  that  it  gives  the  best  phase  estimation  error 
because  the  amplitude  estimation  depends  only  on 
therefore  it  is  independent  on  the  positions  of  the 
phase  pixels.  Dividing  by  Kp^Kp2  in  the  right-hand 
side  of  the  last  equation  in  Eqs.  (27)  shows  that  the 
phase  estimation  error  depends  on  the  estimation 
error  of  DJKp^  and  D2lKp2^  On  the  other  hand, 
these  depend  on  the  amplitude  estimation  error 
through  coefficients  K^JKpi,  /^2i/^pi>  and 

K22lKp2^  Minimizing  these  coefficients  improves 
the  phase  estimation  error.  To  find  the  position  of 
the  phase  pixels  that  will  do  this  minimization,  we 
use  Eqs.  (23)  and  approximate  the  receiver  functions 
as  triangle  functions  defined  by 


r{x,y) 


[O  elsewhere 


for  \x\,  |y|  <  qh 


We  also  consider  the  regions  of  integration  to  be  small 
enough  such  that  we  can  approximate  the  integrals  in 
Eqs.  (23)  with  the  values  of  the  integrand  at  the 
receiver  pixel  position  (xp„  yp^)  or  (0,  0).  Thus  Ki^/ 
Kpi  and  K2ifKpi  are  given  by 


1^11  _  qh-  Xpi 

{q  ~  ^)h  +  Xpi  ’ 

K21  l)h  +  Xpi 

Kpi  qh  Xpi 

Similarly,  Ki2lKp2  and  K22IKP2  are  given  by 


(29) 


Kr2 

1 

1 

0^ 

Kp2 

iq  -  l)h  +  Xp2  ’ 

K22 

(q  -  l)/i  -1-  Xp2 

Kp2 

qh  -  Xp2 

(30) 


From  Eqs.  (29)  and  (30)  we  find  that,  to  obtain  equal 
sensitivity  to  measurement  errors  in 
nh)\  and  +  l)h,  n/i]|  we  need  to  have 

^pi  “  ^P2  =  h  12  independently  of  y  because  of  re¬ 


ceiver  pattern  separability.  A  similar  set  of  equa¬ 
tions  is  found  for  y  adjacency  and,  likewise,  the  result 
is  that  ypi  =  yp2  =  h/2  independently  of  x. 

The  last  design  constraint  that  needs  to  be  consid¬ 
ered  is  the  phase  difference  |ai  -  a2|.  In  fact,  Eqs. 
(25)  state  that  the  sine  and  cosine  of  the  phase  dif¬ 
ference  depend  on  the  numerator  and  denominator  in 
the  last  equation  of  Eqs.  (27)  through  l/sin(ai  “  a2). 
If  this  is  big  then  the  errors  in  estimating  the  quan¬ 
tities  in  the  numerator  and  the  denominator  will  be 
amplified.  Therefore  we  have  the  design  equation 


|ai-a2|  =  (2p  +  l)^,  (31) 


where  p  is  any  positive  integer  or  zero.  To  find  the 
pixel  positions  that  would  satisfy  the  requirement 
placed  on  the  difference  between  both  phase  angles, 
we  use  relation  (14)  and  Eqs.  (23).  First  we  note 
that  we  can  use  the  built-in  output  phase  shift  of  the 
Fresnel  transformation  by  appropriately  positioning 
the  receiver  phase  pixels.  We  consider  two  phase 
pixels  placed  between  two  adjacent  amplitude  pixels 
somewhere  on  the  y  =  0  line  symmetrically  with 
respect  to  the  middle  point  x  =  hf  2  that  was  found  to 
be  optimal  for  amplitude  error  sensitivity.  The  dif¬ 
ference  in  phase  angles  is  given  by 


tti  -  a2  =  Z. 


n 


r(x",y")*r(x"  -  h,y")dx"dy" 


po,oixpi,ypi) 


-  z. 


I  A 

V  I 


r(a:",  y")*r{x"  -  h,  y")dx"dy' 


L<'o,o(  w,  yp2) 


(32) 


Again,  we  assume  the  size  of  the  phase  pixels  to  be 
small  enough  such  that  to  consider  the  integration 
over  their  areas  as  a  multiplication  by  a  delta  func¬ 
tion.  By  using  relation  (14)  for  the  receiver  pattern 
functions  and  neglecting  the  phase  of  the  Fourier 
transform  of  So'(ic,  y),  we  simplify  Eq.  (32)  to  obtain 


l«i  -  a2l  = 


^|exp 

Zllexp 


.  h{2xpi  -  h) 


\d 

h(^Xp2  hr) 

j- 


\d 


(33) 
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Thus  by  substituting  the  requirement  from  Eq.  (31) 
{p  =  0)  into  Eq.  (33)  we  obtain  the  design  equation 


\xpi  —  Xp2  =  »  (34) 

4/i 

Because  Eq.  (34)  is  found  by  drastically  approximat¬ 
ing  Eqs.  (23),  it  should  thus  be  treated  as  a  rule  of 
thumb  and  used  to  obtain  an  order-of-magnitude 
value  for  the  phase  pixel  separation  distance.  In 
fact,  the  actual  phase  pixel  positions  are  found  by 
trial  and  error  iteration  starting  with  values  around 
the  midpoint,  x  =  h/2,  and  given  by  Eq.  (34).  Fi¬ 
nally,  because  the  intensity  measured  by  the  phase 
pixels  is  the  integration  of  a  local  fringe  pattern,  the 
modulation  of  the  detected  signal  is  proportional  to 
the  ratio  between  the  inverse  of  the  local  spatial  fre¬ 
quency  and  the  size  of  the  receiver  pixel.  Therefore 
the  modulation  would  increase  with  decreasing  pixel 
size  Ajc  X  Ay.  However,  this  would  decrease  the 
level  of  the  detected  signal,  and  the  biggest  pixel  size 
that  still  gives  good  reconstruction  error  has  to  be 
chosen.  In  Subsections  3. A  and  3.B  we  test  this  SFS 
design  both  numerically  and  experimentally. 

3.  Testing  the  Sampling  Field  Sensor 

A.  Numerical  Simulations 

The  following  numerical  simulations  depend  on  par¬ 
ticular  design  parameters  chosen  to  closely  match  our 
experimental  system.  The  particular  design  param¬ 
eters  are  enumerated  here  for  completeness  as  fol¬ 
lows: 

h  =  110  jxm; 
a  =  10  |jLm; 
d  =  1400  jxm; 

=  0.1  |Lim“^  with  a  Hanning  window; 

Xpix  =  ypiy  =  55.0  |xm,  ypi^  =  Xpiy  =  0.0  ixm; 

^P2x  ~  yp2y  ~  55.0  fxm,  yp2.t  ”  ^P2y  “7.0  |JLm; 

Ajc  =  Ay  =  3  |xm.  (35) 

The  meaning  of  the  parameters  in  the  last  three 
equations  in  Eqs.  (35)  is  shown  in  Fig.  3.  Only  one 
period  of  the  periodic  structure  of  receiver  pixels  is 
shown.  The  period  of  the  structure  is  given  to  be  /i  = 
110  |xm,  and  the  focal  lengths  of  the  lenses  in  the  4/ 
system  are  not  given  because  we  assumed  a  perfect 
unit  magnification  imaging  system. 

It  is  of  interest  to  know  how  well  the  SFS  described 
in  Section  2  detects  the  amplitudes  and  the  phase 
differences  between  adjacent  samples  of  the  input 
field.  As  a  measurement  of  detection  error  we  use 
the  difference  between  the  simulated  input  field  (am¬ 
plitude  or  phase),  evaluated  at  the  center  point  of 
each  sampling  period,  and  the  estimate  obtained  us- 


Fig.  3.  Exact  layout  of  the  receiver  mask,  one  receiver  cell  only. 
A  marks  the  amplitude  pixel  and  PI  and  P2  are  the  two  types  of 
phase  pixels. 

ing  our  method  and  SFS  device.  That  is,  the  detec¬ 
tion  error  is  defined  as 

N'mfl  =  nh)\  -  \fi„imh,  nh)\\, 

flh)  -  ip[mh,  {u  +  1)A]} 

-  nh)  -  (n 

+ 1)/^]}|,  (36) 

where  A/*  is  the  amplitude  error  and  Acp  is  the  phase 
error.  Only  x  adjacency  is  shown  in  Eqs.  (36)  for 
brevity.  We  simulate  the  field  transformation  im¬ 
plemented  by  the  SFS  and  described  in  Section  2  by 
considering  it  to  be  a  windowed  Fresnel  transforma¬ 
tion.  As  noted  above,  this  neglects  vignetting  and 
the  aberrations  of  the  4/“  system.  The  simulated  in¬ 
put  field  was  generated  by  approximate  prolate  in- 
terpolation^i  from  a  set  of  samples  that  oversampled 
the  band-limited  input  field.  In  this  way  it  is  possi¬ 
ble  for  one  to  go  to  a  higher  order  of  accuracy  in  the 
Fresnel  diffraction  calculations  by  changing  only  the 
interpolation  distance  and  not  the  input  samples. 
The  samples  had  the  real  and  imaginary  parts  uni¬ 
formly  distributed  random  variables  in  the  interval 
[-0.5, 0.5].  The  lateral  dimensions  of  the  simulated 
fields  were  2.2  mm  X  2.2  mm  sampled  at  1  jxm  in  both 
Cartesian  directions.  We  used  fast  Fourier  trans¬ 
forms  to  calculate  the  Fresnel  diffraction  integral. 
This  was  performed  in  a  serial  fashion  by  our  consid¬ 
ering  that  the  output  of  one  receiver  cell  is  due  to  the 
field  coming  from  a  corresponding  3x3  region  in  the 
input.  The  error  would  go  to  zero  if  the  correspond¬ 
ing  input  region  were  extended  to  include  all  the 
input  points.  This  would  be  impractical  for  the  size 
of  the  input  in  our  case.  To  check  if  the  3x3  win¬ 
dow  is  big  enough,  we  increased  its  size  to  5  X  5  and 
ran  a  simulation  for  the  field  with  the  highest  input 
bandwidth.  We  foimd  that  the  change  in  the  error 
was  insignificant  so  we  kept  a  3  X  3  window  in  all 
subsequent  tests.  The  SFS  had  20  X  20  periods, 
hence  there  were  400  detection  points.  To  calculate 
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Table  1.  Error  in  Calibrating  the  SFS  Parameters  with  a 
Least-Squares  Fit“ 


Calibration  Error 

Field 

Phase  Pixel  1 

Phase  Pixel  2 

Percentile 

Residual 

Percentile 

Residual 

Bandwidth 

Error  (%) 

Error*  (a.u.) 

Error  (%) 

Error*  (a.u.) 

1/2200 

0.26  ±  0.49 

7.52  X  10-® 

0.19  ±  0.41 

9.96  X  10'® 

1/1980 

0.26  ±  0.46 

8.26  X  10“® 

0.16  ±  0.6 

8.40  X  10-® 

1/1760 

0.19  ±  0.4 

4.39  X  10"® 

0.14  ±  0.4 

1.20  X  10"® 

1/1540 

0.2  ±  0.35 

4.77  X  10-® 

0.16  ±  0.29 

2.29  X  10“® 

1/1320 

0.3  ±  0.95 

8.22  X  10"® 

0.29  ±  0.74 

2.42  X  10'® 

1/1100 

0.36  ±  0.95 

1.33  X  10"® 

0.35  ±  0.88 

1.41  X  10'® 

1/880 

0.4  ±  1.15 

1.52  X  10“® 

0.56  ±  1.35 

3.60  X  10'® 

1/660 

0.85  ±  1.65 

3.85  X  10"® 

0.83  ±  1.35 

5.03  X  10'® 

1/440 

1.21  ±  2.28 

6.34  X  10"® 

1.89  ±  2.95 

1.05  X  lO"'* 

1/220 

2.64  ±  3.28 

2.18  X  lO"" 

5.6  ±  6.1 

3.17  X  10'^ 

“Residual  error  is  the  vector  of  calibration  errors  at  all  the 
points. 

^Norm  of  the  residual  error  vector.  It  indicates  goodness  of  fit. 


the  error,  the  input  field  firSjnh,  nh)  is  taken  after  the 
interpolation  step  to  avoid  including  the  interpola¬ 
tion  error  in  the  estimation  error. 

The  SFS  simulations  consisted  of  two  steps.  First, 
we  calibrated  the  system  by  finding  the  values  of  the 
K  parameters  (a^  2  included).  For  this  we  used  each 
of  the  input  fields  as  the  test  input.  We  fit  the  input 
data  to  the  measurements  using  least  squares  with 
Eqs.  (20)  and  (22).  The  results  of  the  calibration  are 
given  in  Table  1  for  the  different  simulated  input 
fields.  The  calibration  error  for  is  under  0.05% 
and  is  not  included.  The  results  show  that  the  error 
in  calibrating  the  system  increases  with  input  band¬ 
width.  This  is  due  to  the  gradual  breakdown  with 
increasing  input  bandwidth  of  the  modal  representa¬ 
tion  of  the  output  given  in  Eq.  (3).  This  will  make 
the  detection  error  increase  with  input  bandwidth 
and  is  considered  a  systematic  error  of  the  model  as 
no  noise  factors  were  considered.  Phase  wrapping 
causes  an  additional  increase  in  the  estimation  error. 
The  second  step  was  to  use  the  calibrated  parameters 
to  estimate  the  amplitude  and  phase  of  the  input  field 
with  Eqs.  (27).  We  used  the  parameters  obtained 
from  one  of  the  calibration  tests  in  all  the  simulated 
measurement  tests.  For  comparison  we  simulated 
the  detection  of  the  same  input  field  using  a  SHS. 
The  SHS  consisted  of  an  array  of  lenses  with  focal 
length  F  =  1400  |xm  and  a  lens  period  of  ft  =  110  |xm 
(the  same  as  the  SFS  sampling  period).  The  work¬ 
ing  aperture  of  each  lens  was  considered  to  cover  the 
entire  110  jim  X  110  [xm  area  of  its  corresponding 
period.  We  estimated  the  amplitude  associated  with 
the  center  of  each  lens  or  central  sampling  point  by 
integrating  the  intensity  in  the  SHS  focal  plane.  We 
estimated  the  phase  difference  between  sampling 
points  at  the  opposite  edges  of  each  period  (both  x  and 
y  directions)  in  the  input  plane  by  finding  the  centroid 
of  the  intensity  distribution  in  the  focal  plane  of  each 
lens.  The  intensity  in  the  output  plane  is  detected 
by  an  array  of  detectors  placed  on  a  rectangular  grid 


Table  2.  Comparison  of  Detection  Errors  of  SFS  and  SHS 


Field 

Bandwidth 

Absolute  Error  (rad) 

Relative  Error 

SFS“ 

SHS“ 

SFS  (%) 

SHS  (%) 

1/2200 

0.002  ±  0.004 

0.02  ±  0.16 

1.5  ±  3 

3  ±  10 

1/1980 

0.002  ±  0.004 

0.01  ±  0.1 

1.5  ±  2 

2  ±  8 

1/1760 

0.002  ±  0.004 

0.02  ±  0.15 

2  ±  5 

4±  10 

1/1540 

0.003  ±  0.005 

0.04  ±  0.24 

3±7 

6±  14 

1/1320 

0.004  ±  0.0075 

0.01  ±  0.08 

3  ±  20 

3±6 

1/1100 

0.007  ±  0.05 

0.05  ±  0.3 

3±8 

10±  20 

1/880® 

0.02  ±  0.27 

0.1  ±  0.3 

5  ±  16 

12  ±  20 

1/660 

0.01  i  0,05 

0.1  ±  0.4 

6±23 

15  ±30 

1/440® 

0,04  ±  0,2 

0.3  ±  0.6 

9  ±23 

30±  50 

1/220® 

0.12  ±  0.5 

0.95  ±  1.0 

20  ±  110 

80  ±  120 

“±  indicates  that  the  following  quantity  is  the  standard  devia¬ 
tion.  The  error  cannot  be  negative  because  it  is  the  absolute  value 
of  the  difference  between  the  estimated  phase  difference  and  the 
actual  phase  difference. 

^Unreasonably  high  standard  deviation  given  by  a  possible  cal¬ 
ibration  error  of  the  phase-shift  parameters;  see  text. 


with  a  1.73-|LLm  spacing  in  both  directions.  We  con¬ 
sidered  the  field  in  the  focal  plane  of  each  lens  to  be 
given  by  the  Fourier  transform  of  the  field  at  the  lens 
plane.  This  is  justified  for  a  slow  lens  (//lO  and 
slower)  as  described  by  Goodman.^®  Both  the  aber¬ 
rations  of  the  lenses  as  well  as  the  cross  talk  between 
the  output  fields  of  adjacent  lenses  were  neglected 
because  this  would  only  increase  the  estimation  er¬ 
ror.  Neglecting  the  cross  talk  effectively  amounted 
to  a  spatial  frequency  band  limit  J5  =  x^^/\F  =  0.06 
ixm“^  for  Xjuax  =  55  fjim.  This  is  comparable  to  the 
O.l-jxm”^  limit  in  the  SFS  case. 

The  phase  estimation  error  for  both  sensors,  as 
given  by  the  second  relation  in  Eqs.  (36),  is  shown  in 
Table  2  with  absolute  and  relative  values  that  are 
normalized  to  the  actual  phase  difference.  The 
points  where  the  error  was  within  five  standard  de¬ 
viations  from  211  were  excluded  from  the  absolute 
error  calculations  to  avoid  including  wrapping  error. 
The  standard  deviation  figure  used  initially  was  ob¬ 
tained  by  our  considering  only  the  points  with  an 
error  less  than  0.5  rad.  Also,  the  points  where  the 
input  phase  difference  was  smaller  than  10“^  rad 
were  additionally  excluded  from  the  relative  error 
calculations.  Note  that  97%  on  average  and  no  less 
than  93%  of  the  total  number  of  points  were  included 
in  the  calculations  in  all  cases  for  both  sensors.  The 
amplitude  error  is  not  shown  as  it  is  practically  zero 
for  the  SFS  and  ranges  from  5^100%  for  the  band- 
widths  considered  in  the  SHS  case.  Note  that  the 
standard  deviations  for  the  1/880-,  1/440-,  and 
l/220-|xm“^  entries  in  Table  2  are  much  bigger  than 
in  the  rest  of  the  cases  and  are  comparable  in  size  to 
TT.  This  is  because  there  are  a  few  points  in  the  input 
phase  differences  that  are  close  to  or  —tt  and  are 
estimated  to  be  at  the  opposite  side,  i.e.,  close  — tt  and 
IT,  respectively.  The  possible  cause  for  this  is  an 
error  in  calibrating  the  012  parameters  corroborated 
with  the  wrapping  of  the  phase.  As  explained  above, 
this  error  increases  with  input  field  bandwidth  (see 


80  APPLIED  OPTICS  /  Vol.  39,  No.  1  /  1  January  2000 


aiOO 

o 

S  ao 
E 


Error  dose  to  2n  due  to  mis- 
celibration  and  phase  wrapping. 

i 


0.8  1  1.2 
Error  (radians/*] 


Fig.  4.  Histogram  of  phase  estimation  error  at  maximum  input 
bandwidth  (1/220  The  size  of  the  SFS  sampling  grid  is 

20  X  20,  thus  there  are  760  phase  estimation  points.  There  are  14 
points  with  an  error  within  2  rad  of  2'it. 


Table  1).  A  possible  remedy  would  be  to  use  more 
than  two  phase  pixels  having  different  phase  shifts. 
The  inversion  algorithm  would  then  use  this  redim- 
dant  information  to  reduce  the  error.  If  we  elimi¬ 
nate  the  points  for  which  the  difference  between  the 
input  and  the  detected  phase  difference  is  within  2.0 
rad  of  2^7,  the  errors  change  to  0.01  ±  0.02  rad  for  the 
l/880-p.m“^  case,  to  0.03  ±  0.05  rad  for  the  1/440- 
case,  and  to  0.1  ±  0.15  rad  for  the  1/220-fxm"^ 
case.  Note  that  only  2  points  in  the  first  case,  4 
points  in  the  second,  and  14  points  in  the  third  case 
had  to  be  eliminated.  This  is  from  a  total  of  760 
phase  differences.  Another  way  to  see  that  there  are 
just  few  points  around  ±77  that  cause  this  problem  is 
to  plot  the  histogram  of  the  error  vector  (difference 
between  the  input  and  the  detected  values)  as  we 
show  in  Fig.  4  for  the  l/220-p,m“^  case. 

Although  limited  in  scope,  the  simulations  show  a 
considerably  smaller  error  for  the  SFS  method  as 
opposed  to  the  SHS  method.  In  a  real  situation, 
however,  the  poor  light  throughput  of  this  particular 
SFS  implementation  is  likely  to  tip  the  balance  of  the 
comparison  in  the  opposite  direction.  To  quantify 
this  statement  we  consider  the  detection  SNR  as  lim¬ 
ited  by  the  shot  noise  only.  We  consider  SNRsps 
SNRshs  be  the  signal-to-noise  ratios  of  the  two 
systems.  For  the  case  described  here,  the  ratio 
SNRsfs/SNRshs  will  be  approximately  equal  to  the 
ratio  of  the  power  throughput  of  the  two  systems, 
which  is  of  the  order  of  10”^.  This  means  that  10^ 
more  power  is  required  by  the  SFS  to  have  the  same 
shot-noise-limited  SNR  as  the  SHS.  This  imple¬ 
mentation  of  the  fan-out  stage  is  a  simple  one  meant 
for  testing  the  sensor  concept.  Other  implementa¬ 
tions,  from  the  realm  of  array  generation  techniques, 
can  potentially  increase  the  power  throughput  by  2 
orders  of  magnitude.  On  the  other  hand,  its  simplic¬ 
ity  and  real-time  phase  detection  capability  may 
make  it  attractive  for  applications  such  as  high- 
energy  laser  testing.  We  also  note  that  our  sensor 
concept  has  a  (-T7,  t7)  dynamic  range,  similar  to  any 


Fig.  5.  Detection  of  a  random  input  field  with  a  spatial  bandwidth 
of  1/220  pm"  \  The  input  values  are  marked  with  circles  and  the 
estimated  values  are  marked  with  crosses:  (a)  input  field  (real 
part)  with  B  =  1/220  pm"\  (b)  SHS  amplitude  detection,  (c)  SFS 
phase  detection,  and  (d)  SHS  phase  detection. 


shearing  interferometer.  The  SHS  does  not  have 
this  limitation. 

Figures  5  and  6  show  the  results  obtained  with 
both  sensors  for  two  types  of  input  fields.  Figure  5 
shows  the  maximum  input  bandwidth  and  Figure  6 
shows  a  typical  low-bandwidth  field.  The  amphtude 
detection  error  is  shown  only  for  the  SHS  because  it 
is  small  in  the  SFS  case.  Each  set  of  figures  contains 
a  view  of  the  real  part  of  the  input  field,  the  estimated 
amplitude  versus  the  input  amplitude,  and  the  esti¬ 
mated  phase  difference  versus  the  input  phase  dif¬ 
ference.  The  estimated  values  are  marked  in  the 
figures  with  crosses  and  the  input  values  with  circles 
for  each  of  the  400  detection  points.  Perfect  estima- 
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Fig.  6.  Detection  of  a  random  input  field  with  a  spatial  bandwidth 
of  1/2200  pm"^  The  input  values  are  marked  with  circles  and 
the  estimated  values  are  marked  with  crosses:  (a)  input  field 
(real  part)  with  B  -  1/2200  pm"^,  (b)  SHS  amplitude  detection,  (c) 
SFS  phase  detection,  and  (d)  SHS  phase  detection. 
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Fig.  7.  SHS  and  SFS  phase  detection  error  for  low  input  band¬ 
width.  The  input  values  are  marked  with  circles  and  the  esti¬ 
mated  values  are  marked  with  crosses:  (a)  SFS  detection  and  (b) 
SHS  detection. 


tion  occurs  every  time  the  cross  is  centered  in  the 
circle  for  the  respective  detection  point. 

The  poor  amplitude  and  phase  estimation  of  the 
SHS  are  due  to  the  fact  that  the  values  of  the  field 
amplitude  and  phase  at  the  sampling  point  are  close 
to  the  values  estimated  only  when  the  input  field  has 
a  low  enough  spatial  bandwidth.  This  is  because  the 
sensor  estimates  the  average  values  of  the  two  quan¬ 
tities^^  for  each  subaperture.  According  to  the  mean 
value  theorem,  these  values  are  close  to  the  actual 
values  at  the  sampling  points  only  for  small  enough 
input  band  widths.  This  explains  why  the  output  of 
the  SHS  for  1/2200  jxm”^  is  much  better  than  for 
1/220  |xm“^.  Also,  the  SHS  still  shows  considerable 
error  compared  with  the  SFS  at  certain  estimation 
points,  even  for  low  input  bandwidths.  Figure  7 
shows  a  detail  of  the  graphs  in  Figs.  6(c)  and  6(d)  to 
illustrate  this  fact. 


Fig.  8.  Experimental  setup.  Sampling  mask  is  a  40  X  40  array 
of  10-pm-square  holes  in  a  chrome  coating  over  a  1-mm-thick 
quartz  substrate.  The  focal  lengths  of  the  lenses  Lj,  Lg,  and 
L4  are  F2-  50  mm  and  F^-  F^-  100  mm.  The  sampling 
mask  is  placed  approximately  1  mm  in  front  of  the  front  focal  plane 
of  Li.  The  aperture  of  the  stop  in  the  Fourier  plane  of  the  first 
lens  is  3  mm.  The  camera  is  a  576  X  384  CCD  array  with  22- 
jim-square  pixels. 

The  wavelength  of  the  laser  radiation  was  between 
620  and  680  nm  according  to  manufacturer's  specifi¬ 
cations.  Our  measurements  indicated  a  value  of 
690  ±  20  nm.  The  output  of  the  system  at  normal 
incidence  is  shown  in  Fig.  9(d).  The  log  base  10  of 
the  measured  intensity  is  shown.  The  experiment 
consisted  of  rotating  the  steering  mirror  over  a 
[-0.2°,  +0.2°]  interval  to  scan  the  incidence  angle. 
The  signal  at  the  amplitude  and  the  phase  pixels  was 
recorded.  For  a  clean  measurement,  the  tilted  plane 
wave  model  of  the  experiment  predicts  a  sinusoidal 
modulation  in  the  phase  pixels  of  a  period  given  by 


B.  Experimental  Results 

We  performed  a  set  of  experiments  to  further  test  our 
method.  Ideally  we  want  to  find  the  K  parameters  to 
be  able  to  estimate  an  arbitrary  field.  Here  we  pro¬ 
pose  a  first  step  toward  that  goal:  input  a  tilted 
plane  wave  to  the  system  and  check  if  the  intensities 
in  the  phase  pixels  show  a  sinusoidal  variation  with 
the  change  in  incidence  angle.  The  experimental 
setup  is  shown  in  Fig.  8.  It  consists  of  two  cascaded 
4/* systems  that  form  the  image  of  a  sampling  mask  on 
a  CCD  camera.  The  first  4/*  system  had  a  3-mm 
hard-edge  low-pass  aperture  in  the  Fourier  plane  and 
a  magnification  of  2.0  X .  The  focal  lengths  of  the  two 
lenses  were  50  and  100  mm,  respectively.  The  sec¬ 
ond  cascaded  Af  system  was  identical  to  the  first  one 
but  without  any  stop  in  its  Fourier  plane.  The  CCD 
pixel  size  was  22  X  22  |xm.  As  discussed  in  Subsec¬ 
tion  2.B,  a  small  enough  receiver  pixel  size  is  neces- 
saiy  to  obtain  good  modulation  in  the  phase  pixels. 
The  overall  magnification  of  4.0X  ensured  an  effec¬ 
tive  receiver  pixel  size  of  around  5  |xm,  close  to  the 
value  in  the  simulations.  The  sampling  mask  con¬ 
sisted  of  10-|xm-square  holes  spaced  at  110  |xm.  It 
was  placed  approximately  1  mm  in  front  of  the  object 
plane  of  the  system.  The  input  to  the  system  was  a 
collimated  beam  coming  from  a  laser  diode  and 
steered  with  a  mirror  moimted  on  a  rotation  stage. 
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Fig.  9.  Experimental  results:  (a)  signal  in  a  phase  pixel  as  a 
function  of  mirror  tilt  angle,  (b)  signal  in  two  adjacent  amplitude 
pixels  as  a  function  of  mirror  tilt  angle,  (c)  signal  in  the  same  phase 
pixel  for  a  smaller  range  of  angles  (working  bandwidth)  with  a 
sinusoid  fitting  it,  and  (d)  intensity  (log  10)  in  the  output  plane  of 
the  device. 
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Fig.  10.  Experimental  verification,  (a)  Change  in  the  receiver 
pattern  function  with  angle  of  incidence.  The  receiver  pattern 
function  is  different  for  different  values  of  the  incidence  angle. 
This  is  due  to  the  failure  of  the  SFS  representation  to  model  the 
output  field  at  high  input  bandwidths  (the  model  breaks  down), 
(b)  Histogram  of  the  measured  period  for  300  phase  pixels.  The 
average  period  is  approximately  150  mdeg  with  a  standard  devi¬ 
ation  of  40  mdeg  which  is  in  agreement  with  the  theoretical  esti¬ 
mate. 


Assuming  X  -  680  nm,  Eq.  (34)  yields  a  value  T  =  177 
mdeg  of  stage  rotation  angle.  Figure  9(a)  shows  the 
intensity  at  a  phase  pixel  [pixel  (63,63)  in  Fig.  9(d), 
which  is  81  X  81],  and  Fig.  9(b)  shows  the  intensity  in 
the  corresponding  x  adjacent  amplitude  pixels.  We 
note  the  modulation  of  the  signal  in  the  amplitude 
pixels  that  is  due  to  variable  intensity  in  the  input 
wave  front.  This  degrades  the  ideally  sinusoidal  sig¬ 
nal  in  the  phase  pixels.  The  phase  signal  has  low- 
frequency  components  because  of  a  number  of  other 
factoi‘s  that  are  not  related  to  the  phase  difference 
between  the  two  adjacent  sampling  points.  The 
most  important  factor  is  the  change  in  the  receiver 
pattern  function  with  incidence  angle.  As  pointed 
out  by  the  numerical  simulations,  the  representation 
in  Eq.  (3)  is  valid  on  a  limited  range  of  input  spatial 
frequencies.  To  measure  the  sinusoidal  modulation 
period  we  scanned  the  incidence  angle  and  we  ex¬ 
ceeded  the  angular  range  where  Eq.  (3)  is  valid. 
Therefore  we  could  not  use  it  to  represent  the  de¬ 
tected  signal  over  the  entire  range  of  angles.  In  fact, 
the  receiver  pattern  functions  shift  laterally  and, 
when  the  incidence  angle  is  increased  over  a  certain 
value,  the  shift  cannot  be  neglected.  The  fact  that 
we  use  a  hard-edge  stop  in  the  Fourier  plane  as  op¬ 
posed  to  the  windowed  Fourier  transform  used  in  the 
simulations  makes  the  receiver  pattern  functions 
even  more  dependent  on  the  incidence  angle  of  the 
input  field  because  of  the  more  pronounced  sidelobes. 
Figure  10(a)  shows  the  change  in  the  receiver  pat¬ 
terns  with  incidence  angle.  Restricting  the  data  to  a 
200-mdeg  range  roughly  corresponding  to  the  [-1/ 
2h,  l/2/i]  working  bandwidth,  we  obtain  a  modula¬ 
tion  period  of  approximately  160  mdeg,  close  to  the 
one  predicted  by  Eq.  (34).  Figure  9(c)  shows  the 
signal  in  this  range  as  well  as  the  fitted  sinusoidal 
modulation.  In  fact,  we  considered  the  signals  from 
300  phase  pixels  placed  in  the  middle  region  between 
adjacent  amplitude  pixels.  The  amplitude  pixels 
were  placed  at  the  maxima  of  the  intensity  patterns. 
Figure  10(b)  shows  the  histogram  of  the  measured 


periodicity  distribution.  The  average  value  is  ap¬ 
proximately  150  mdeg  with  a  standard  deviation  of 
40  mdeg,  which  is  in  agreement  with  the  theoretical 
estimation  from  Eq.  (34).  Also,  our  experiments  em¬ 
phasized  the  real-time  capability  of  the  SFS.  We 
attempted  to  make  the  same  measurement  but  using 
a  phase-stepped  Mach-Zehnder  shearing  interferom¬ 
eter  instead.  We  did  not  obtain  meaningful  data 
until  we  decreased  the  shear  to  approximately  16  |xm 
as  opposed  to  110  pm  in  the  SFS  case.  This  was  due 
to  the  beam  pointing  error  of  the  laser  diode  and  the 
fact  that  we  were  using  a  multiframe  technique.  We 
used  the  measurements  taken  with  the  Mach- 
Zehnder  interferometer  to  estimate  a  sinusoidal  pe¬ 
riod  of  182  ±  10  mdeg,  confirming  our  previous 
estimate. 

C.  Discussion 

We  tested  the  consistency  of  the  SFS  method  both 
numerically  and  experimentally.  Numerical  simu¬ 
lations  proved  the  wave-front  sensing  principle  of 
this  device.  We  showed  experimentally  that  the  sig¬ 
nal  detected  in  the  phase  pixel  is  proportional  to  the 
cosine  of  the  phase  difference  between  two  adjacent 
sampling  points.  The  most  important  drawback  of 
the  current  implementation  of  the  fan-out  stage  is  the 
low  light  throughput.  Alternative  methods,  such  as 
array  generation  techniques,  may  also  be  considered. 
For  example,  one  can  use  diffractive  masks  placed  in 
the  Fourier  plane  of  the  4f  system.  This  could  in¬ 
crease  the  light  throughput  by  2  orders  of  magnitude. 
Also,  one  can  use  matrices  of  diffractive  lenses  in¬ 
stead  of  the  refractive  lenses  used  in  this  research. 
By  reducing  the  focal  lengths,  we  could  make  the 
system  more  compact,  possibly  by  2  orders  of  magni¬ 
tude.  Ideally,  use  of  an  array  generator  as  the  fan¬ 
out  element  would  create  multiple  phase-shifted 
replicas  of  the  sampling  mask  at  the  receiver  plane, 
thus  making  possible  use  of  one-shot  phase-stepping 
interferometry  techniques.  Use  of  the  sampling 
stage  is  the  key  element  to  allow  for  allocating  the 
blocked  regions  in  the  input  to  measurement  regions 
in  the  output.  However,  the  setup  that  we  pre¬ 
sented  has  the  advantage  of  being  easy  to  implement. 
Equations  (13)  suggest  that  we  can  eliminate  the  4f 
system  if  we  could  make  the  sampling  function  So(-^) 
band  limited,  like  a  tapered  hole,  for  example.  In 
this  way  the  first  two  factors  of  the  convolution  could 
be  replaced  by  a  tapered  sampling  hole  without 
changing  the  overall  operation  of  the  system.  The 
tapered-hole  SFS  sampling  mask  would  be  placed 
approximately  1  mm  in  front  of  a  CCD  array.  This 
simple  improvement  would  make  the  system  consid¬ 
erably  smaller  and  thus  less  sensitive  to  vibrations. 
Materials  for  true  gray-level  masks  are  commercially 
available. 

One  problem  that  must  be  solved,  before  a  success¬ 
ful  implementation  of  the  SFS  can  be  accomplished, 
is  the  calibration  procedure.  Obtaining  the  values  of 
the  K  parameters  was  easy  in  the  simulation  because 
we  had  access  to  the  input  field  directly.  This  was 
not  the  case  for  the  experiment.  Having  greater 
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light  throughput  as  well  as  a  better  SNR  of  the  signal 
in  the  phase  pixels  would  allow  use  of  more-refined 
calibration  procedures. 

4.  Conclusions 

We  proposed  a  new  wave-front  sensing  method  based 
on  reconstructing  the  input  field  from  its  samples  and 
demonstrated  a  particular  sensor  implementation. 
Numerical  tests  showed  that  it  can  detect  the  phase 
of  input  fields  up  to  the  Nyquist  limit  with  an  error 
increasing  with  bandwidth  but  lower  than  20%.  Ex¬ 
perimental  tests  showed  the  consistency  of  the  model 
by  correctly  measuring  the  tilt  of  a  plane  wave  at  a 
VEiriable  incidence  angle.  However,  we  were  unable 
to  solve  the  system  calibration  problem  and  therefore 
reconstruct  arbitrary  fields.  Alternative  techniques 
similar  to  array  generation  may  be  used  in  designing 
the  fan-out  stage  of  the  device  and  improving  its  light 
efficiency.  The  fact  that  the  SFS  could  sense  fields 
with  bandwidths  up  to  the  Nyquist  limit  make  it  a 
good  candidate  for  applications  that  require  detection 
of  high  information  content  fields.  Its  one-shot 
phase  detection  capability  could  benefit  a  number  of 
applications  needing  real-time  full-field  detection. 
In  summary,  the  main  qualities  of  the  SFS  are  its 
potential  compactness,  ease  of  use,  and  real-time 
phase  detection.  Compactness  reduces  its  sensitiv¬ 
ity  to  vibrations  and,  together  with  the  other  two 
characteristics,  could  help  spread  use  of  optical  phase 
detection  systems  outside  the  laboratory  environ¬ 
ment. 
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Visible  Cone-Beam  Tomography 
With  a  Lensless  Interferometric 

Camera 

Daniel  L.  Marks,*'*^  Ronald  A.  Stack/  David  J.  Brady/'^* 

David  C.  Munson  Jr./*^  Rachael  B.  Brady^ 

Digital  processing  of  optical  coherence  functions  can  reconstruct  three-dimen¬ 
sional  objects  illuminated  by  incoherent  light.  It  is  shown  that  Fourier  analysis 
of  the  mutual  intensity  of  the  field  produces  projections  that  are  mathemat¬ 
ically  identical  to  the  projections  of  x-ray  cone-beam  tomography.  A  lensless 
interferometric  camera  that  captures  planes  of  mutual  intensity  data  is  de¬ 
scribed  and  used  to  reconstruct  an  incoherently  illuminated  visible  object  in 
three  dimensions. 

Lenses  act  as  analog  computers  that  transform  plicity  (7).  If  the  field  arises  from  a  primary 

the  incident  field  into  an  image  of  the  field  in  a  source  in  free  space,  its  value  at  point  1  is  a 

particular  plane.  With  the  continuing  digital  superposition  of  Huygens  wavelets.  This  super¬ 
revolution,  one  may  wonder  whether  this  ana-  position  can  be  expressed  as 

log  processing  can  be  digitally  enhanced.  This  where  j  represents  V^,  is  the 

report  describes  digital  imaging  with  an  optical  source  field  density,  k  —  2ir/\,  and  position 

system  consisting  only  of  smooth  planar  surfac-  vector  is  the  variable  of  integration.  The 

es.  As  is  often  the  case  when  a  digital  processor  integral  is  over  the  source  volume,  and  7?^^  is 

replaces  an  analog  one,  our  motivation  is  to  the  distance  from  a  source  point  to  point  1.  For 

improve  the  analog  algorithm.  The  improve-  a  spatially  incoherent  source,  {E^E/)  - 

ment  we  obtain  is  infinite  depth  of  focus,  which  —  r^,),  where  7^  is  the  source  intensity  density 

is  equivalent  to  the  geometrical  optics  assump-  due  to  the  field  fluctuations  E^  and  E^,  at  points 

tion  that  the  field  propagates  in  nondifffacting  and  r^,,  respectively,  and  8(  )  is  the  Dirac 
rays.  This  assumption  is  satisfactory  in  medical  delta  function.  After  double  integrations  over 

x-ray  tomography  because  one  is  satisfied  to  and  r^,,  the  expectation  reduces  to  J^2  ~ 

resolve  features  that  are  large  compared  with  Interferometric  as- 

the  wavelength  of  the  illuminating  radiation.  tronomical  imaging  uses  a  far-field  approxima- 

Widi  visible  imaging,  one  often  wishes  to  re-  tion  of  this  integral  in  which  the  source  space 

solve  features  as  close  to  the  wavelength  scale  reduces  to  2D  and  the  exponential  term  be- 

as  possible,  in  which  case  diffraction  cannot  be  comes  a  Fourier  transform  kernel  (2,  3).  The 

neglected.  Here  we  show  that  visible  ray  pro-  integral  can  be  inverted  to  obtain  the  3D  source 

jection  data  obtained  from  digital  analysis  of  density  with  Fourier  or  modal  methods  (4-8), 

interferometric  data  can  be  combined  with  to-  High  depth  of  focus  has  been  studied  in  the 

mographic  algorithms  to  reconstruct  three-di-  context  of  statistical  radiometry  (9). 

mensional  (3D)  objects.  Our  results  show  that 


To  use  the  mutual  intensity  to  obtain 
cone-beam  projections,  we  assumed  that 
source  point  r^.  was  confined  to  a  semiinfinite 
region  >  0  with  Cartesian  coordinates  (x^, 
zj  and  the  coherence  sampling  points 
(for  example,  points  1  and  2)  were  confined 
to  a  planar  aperture  on  =  0.  We  chose  the 
origin  of  the  aperture  at  the  midpoint  between 
the  two  sampling  points  and  defined  Ax 
and  Ay  to  be  the  distance  between  the  sam¬ 
pling  points  along  the  x  and  y  axes.  The 
Cartesian  coordinates  of  the  sampling  points 
are  (Ax/2,  Ay/2,0)  and  (“Ax/2,  -Ay/2,0). 
Finally,  we  made  the  paraxial  approximation 
that  z^  Ax,  Ay,  x^,  y^  for  all  points  in  the 
source  volume  and  in  the  correlation  aper¬ 
ture.  This  implies  that  7?^^  z^  +  [(Ax/2  - 
Xs)^  +  (Ay2  -  yfyiz^  and  ~  + 

[(Ax/2  +  +  (Ay2  +  7s)^]/2z^.  Under  this 

approximation, 

JitLX.Ly)  = 

j ^  (  XsAx+yAyj  d'^r,  (1) 

where  X  is  the  center  wavelength  of  the 
source.  Taking  the  inverse  Fourier  transform 


Fig.  2.  Photograph  of  the  test  object  The  max¬ 
imal  length  of  the  object  is  7.2  cm,  the  width  is 
2.1  cm,  and  the  height  is  4.9  cm. 


neither  point-by-point  scanning,  as  in  confocal 
microscopy  or  coherence  tomography,  nor  heu¬ 
ristic  analysis,  as  in  computer  vision,  is  neces¬ 
sary  for  3D  reconstmction  and  that  diffraction- 
limited  3D  optical  reconstmction  is  possible 
from  purely  physical  field  analysis. 

We  obtained  infinite  depth  of  focus  images 
by  digital  analysis  of  the  mutual  intensity  func¬ 
tion.  For  quasi-monochromatic  light,  the  mutu¬ 
al  intensity  between  two  points  is  7^2  “ 
where  (  )  is  the  statistical  expected  value.  E^ 
and  E2  are  the  complex  field  values  at  points  1 
and  2,  and  we  considered  scalar  fields  for  sim- 
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nology,  ^Department  of  Electrical  and  Computer  En¬ 
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Fig.  1.  The  rotational  shear 
interferometer  (RSI)  is  a 
two-arm  Michelson-style  in¬ 
terferometer.  A  folding  mir¬ 
ror  consisting  of  a  pair  of 
planar  mirrors  joined  at 
right  angles  terminates  each 
arm.  Each  folding  mirror 
inverts  the  incident  field 
across  its  axis.  The  RSI  mea¬ 
sures  planes  of  Interfer¬ 
ence  data  in  parallel  with 
an  electronic  sensor  array 
in  the  output  aperture.  The 
folding  mirrors  are  nomi¬ 
nally  placed  so  that  the  op¬ 
tical  path  difference  be¬ 
tween  the  arms  is  zero. 
The  interference  is  separat¬ 
ed  from  background  terms 
by  dithering  the  relative 
optical  path  delay  with  a 


translation  stage  on  one  arm.  The  coordinate  system  of  the  object  corresponds  to  (x^,y^,  zj,  and  the 
plane  of  the  sensor  array  corresponds  to  the  correlation  space  (Ax,  Ay). 
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of  Eq.  1  with  respect  to  Ax  and  Hy,  we 
obtained 

J(u,v)  = 

J(^x,^y)  exp[/2'T7(wAx  +  vAj^)]  d^xd^y 


(2) 

J{u,v)  is  a  line  integral  through  IJzl  along  a 
ray  passing  through  the  points  (x^  -  \zji,y^ 
-  Xz^v,  zj.  Values  of  J{u,v)  for  all  allowed 
values  of  u  and  v  correspond  to  integrals 
along  a  cone  of  rays  diverging  from  the  ver¬ 
tex  point  (x^  =  y^  =  z^-  0).  In  x-ray  tomog¬ 
raphy,  a  cone  of  projection  data  is  gathered  by 
placing  a  planar  sensor  on  the  opposite  side  of 
the  object  volume  from  a  point  source.  Equa¬ 
tion  2  shows  that  a  mathematically  equivalent 
cone  of  data  for  a  self-luminous  or  ambiently 
illuminated  visible  object  is  obtained  by  mea¬ 
suring  the  mutual  intensity  on  a  plane  centered 
on  the  equivalent  (but  now  virtual)  point  source. 

Planes  of  mutual  intensity  data  may  be  mea¬ 
sured  in  parallel  with  a  rotational  shear  inter¬ 
ferometer  (RSI)  (Fig.  1)  {10-13),  We  obtained 
experimental  data  using  an  RSI  formed  of  a 
5-cm  aperture  beam  splitter  and  5-cm  folding 
mirrors.  One  of  the  folding  mirrors  was  mount¬ 
ed  on  a  piezo-driven  flexture  stage  to  vary  the 
optical  path  length.  The  only  other  elements  in 
the  optical  system  were  a  mechanical  shutter  at 
the  ^I  input,  a  3-nm  bandpass  spectral  filter 
centered  on  a  wavelength  of  633  nm  at  the 
output  plane,  and  a  512  pixel  by  512  pixel 
back-illuminated  charge-coupled  device  (CCD) 
detector  array.  The  spectral  filter  enforces  the 
quasi-monochromatic  assumption.  For  a  quasi- 
monochromatic  field,  an  RSI  isolates  die  ampli¬ 
tude  and  phase  of  the  mutual  intensity  by  sam¬ 
pling  the  output  plane  intensity  as  a  function  of 
optical  path  ifference.  We  measured  the  output 
for  eight  optical  path  delays  between  the  two 


arms.  The  eight  delays  are  evenly  spaced  over 
one  wavelength  of  maximal  relative  delay.  The 
discrete  Fourier  transform  of  the  intensity  image 
over  these  eight  frames  is  J(Ax,  Ay). 

Cone-beam  tomography  uses  ray  projections 
through  vertices  lying  on  a  curve  called  the 
vertex  path.  Exact  reconstruction  of  an  object 
volume  is  possible  if  all  planes  through  the 
object  volume  intersect  the  vertex  path  {14), 
Vertex  paths  that  sample  incomplete  data  are 
often  used  for  implementation  simplicity.  We 
used  an  algorithm  from  Feldkamp  et  al,  {15)  in 
our  experiments.  This  algorithm  is  based  on  a 
circular  vertex  path.  Our  test  object  (Fig.  2)  was 
placed  1.61  m  from  the  RSI  sensor  plane  and 
illuminated  by  a  white  halogen  lamp.  We  sam¬ 
pled  a  circular  vertex  path  by  rotating  the  object 
in  front  of  the  RSI.  Planes  of  coherence  data 
were  recorded  from  128  vertex  points  equally 
spaced  in  angle  over  one  revolution.  At  each 
vertex  point,  we  captured  eight  frames  of  128  by 
128  intensity  samples.  These  frames  were  de¬ 
modulated  to  estimate  /(Ax,  Ay),  which  was 
then  Fourier  transformed  to  obtain  128  planes  of 
J{u,v)  data.  These  planes  were  used  in  the  cone- 
beam  algorithm  to  reconstruct  the  128  by  128  by 
128  data  volume  (Fig.  3).  The  reconstructed  data 
cube  is  10.6  cm  on  a  side  with  a  resolution  of 
830  |JLm.  The  object  size  and  resolution  are 
determined  by  the  range  and  sampling  rate  of 
(Ax,  Ay).  The  sampling  rate  was  the  CCD  pixel 
spacing  (22  ixm),  and  the  range  was  limited  by 
the  RSI  aperture  (limited  by  the  CCD  array  size 
to  0.63  cm)  and  by  the  angle  between  the  fold 
axes  (6.55°)  to  0.7  mm  {16). 

Our  derivation  assumes  that  the  object  is 
translucent,  but  our  experiment  reconstmcts  an 
opaque  object.  Opacity  has  surprisingly  little 
effect  for  objects  without  occluding  surfaces. 
The  tomographic  reconstruction  of  a  convex 
opaque  object  is  a  linear  superposition  of  the 
reconstructions  of  the  differential  surface  patch¬ 
es  that  make  up  the  object.  The  opacity  of  each 
surface  patch  can  be  modeled  as  a  window  on 
the  solid  angle  over  which  the  patch  radiates. 


The  window  function  produces  a  characteristic 
patch  response  oriented  according  to  the  patch’s 
surface  normal  (Fig.  4).  For  a  convex  object,  the 
reconstruction  is  the  convolution  of  the  surface 
with  the  patch  response  function.  In  the  noncon- 
vex  case,  surface  patches  may  obscure  each 
other,  resulting  in  the  reconstruction  no  longer 
being  a  unique  function  of  the  surface  structure. 
The  volume  surrounding  the  feet  of  the  object 
reported  here  is  nonconvex,  which  leads  to  un¬ 
certainty  in  the  reconstruction  of  this  region 
(Fig.  5). 

Systems  combining  digital  computation 
with  a  coherence  sensor  such  as  the  RSI  can 
achieve  infinite  depth  of  field.  This  property 
makes  cone-beam  tomography  a  flexible  tool  to 
synthesize  3D  stmcture  from  coherence  infor¬ 
mation.  Such  physical  optics  techniques  may 
ultimately  benefit  microscopy  and  machine  vi¬ 
sion  by  providing  3D  reconstructions  of  supe- 


Flg.  5.  Slice  z  =  84  of  the  data  volume  showing 
the  legs,  the  tail  going  down,  and  the  tail 
coming  up.  The  four  top  white  circles  are  cross 
sections  of  the  legs  and  the  bottom  two  circles 
are  cross  sections  of  the  tail.  The  "fill”  between 
the  legs  and  around  the  tail  is  due  to  the 
angular  windowing  resulting  from  occlusion  of 
some  patches. 


Fig.  3  (left).  A  pseudo¬ 
color  volume  render¬ 
ing  of  the  128  by  128 
by  128  reconstructed 
data  volume.  The  haze 
around  the  reconstruct¬ 
ed  data  volume  in  Fig. 

3  is  due  to  the  spa¬ 
tial  distribution  of  the 
patch  response  func¬ 
tion.  Fig.  4  (right). 

The  data  volume  with 
planes  slicing  the  neck 
and  body  of  the  dino¬ 
saur.  The  brightness 
on  the  planes  corre¬ 
sponds  to  the  recon¬ 
structed  intensity  den¬ 
sity.  The  spatial  distri¬ 
bution  of  the  patch  re¬ 
sponse  function  is  readily  visible  on  the  body  slice. 
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nor  resolution.  Nonimaging  sensors  may  pro¬ 
vide  advantages  over  lens-based  cameras,  be¬ 
cause  our  knowledge  of  the  environment  should 
be  limited  by  the  information  available  from  it 
and  not  our  sensing  or  computational  methods, 
analog  or  digital. 
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Chiral  Magnetic  Domain 
Structures  in  Ultrathin  FePd 
Films 
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The  magnetization  profile  of  magnetically  ordered  patterns  in  ultrathin  films 
was  determined  by  circular  dichroism  in  x-ray  resonant  magnetic  scattering 
(CDXRMS).  When  this  technique  was  applied  to  single  crystalline  iron  palladium 
alloy  layers,  magnetic  flux  closure  domains  were  found  whose  thickness  can 
constitute  a  large  fraction  (—25  percent)  of  the  total  film. 


X-ray  reflections  only  occur  when  equivalent 
sites  in  a  crystal  are  occupied  by  identical 
atoms.  If  the  scattering  amplitudes  of  equiv¬ 
alent  sites  are  not  the  same,  then  forbidden 
reflections  can  occur.  These  are  pronounced 
in  the  case  of  resonant  diffraction,  where 
virtual  excitations  from  core  to  valence  states 
impose  the  symmetry  properties  of  the  elec¬ 
tronic  and  magnetic  structure  of  the  material 
{]).  For  instance,  an  antiferromagnetic  order¬ 
ing  will  give  a  magnetic  superlattice  with 
twice  the  size  of  the  charge  distribution. 
Here,  we  show  how  resonant  magnetic  scat¬ 
tering  can  be  used  to  study  complicated  clo¬ 
sure  domain  patterns  (Fig.  1). 

The  domains  display  a  left-right  handed¬ 
ness  known  as  chirality.  It  can  be  verified  that 
the  magnetization  direction  of  each  of  the 
bulk  domains  in  Fig.  1  is  related  to  the  mag¬ 
netization  of  the  closure  domains  right  (left) 
above  by  a  (counter)clockwise  quarter-turn 
rotation  in  the  yz  plane.  This  extra  symmetry 
condition  should  correspond  to  an  additional 
Bragg  condition,  leading  to  an  otherwise  for¬ 
bidden  reflection.  Although  the  possibility  of 
measuring  the  long-period  magnetic  structure 
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by  magnetic  x-ray  scattering  was  suggested 
by  Blume  in  1 985  (2)  and  has  been  success¬ 
fully  applied  to  magnetic  lattice  periodicities 
on  an  atomic  scale  (J),  we  demonstrate  here 
the  case  of  magnetic  domain  structures.  Us¬ 
ing  x-rays  with  circular  polarization,  we  can 
make  an  unambiguous  distinction  between 
magnetic  profiles  with  t  ^  i  ^  t 
t  i  I  J,  domain  patterns  because  only  the 
former  has  a  chiral  structure.  The  observation 
of  circular  dichroism  in  the  x-ray  resonant 
magnetic  scattering  (CDXRMS)  signal,  I — ^that 
is,  its  difference  between  left  and  right  circular¬ 
ly  polarized  photons — allows  us  to  recover  the 
phase  information  that  is  generally  lost  in  dif¬ 
fraction  experiments.  We  demonstrate  that  this 
effect  can  be  directly  related  to  the  magnetiza¬ 
tion  profile  in  the  film. 

To  observe  the  magnetization  directions, 
we  can  use  the  equivalent  in  the  x-ray  region 
of  either  the  Faraday  rotation  of  linearly  po¬ 
larized  light  or  the  Kerr  effect  of  elliptically 
polarized  light.  An  increase  in  the  sensitivity 
for  the  valence  electron  magnetization  is  ob¬ 
tained  by  tuning  the  photon  energy  to  the  Fe 
L3  edge  (wavelength  \  =  17.5  A),  where  a  Ip 
core  electron  is  excited  into  an  empty,  mag¬ 
netically  aligned  2id  state.  This  wavelength  is 
of  the  correct  magnitude  to  be  susceptible  to 
the  magnetic  periodicity  of  the  sample.  The 
scattering  signal  measured  in  a  diffraction 
experiment,  /  |X^  exp(/q*r„)/,p  (where  q  is 

the  photon  wave  vector  transferred  in  the 
scattering  process),  is  the  square  of  the  mod¬ 
ulus  of  the  sum  over  all  lattice  sites,  r„,  of 
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the  scattering  amplitudes,/,,  weighted  by  a 
phase  factor  (4).  Hannon  et  al.  (5)  showed 
that  the  resonant  electrical  dipole  scattering 
amplitude  can  be  written  as 

=  g'  •  eF;,^>-i(e'  Xg)-1VI„F1^) 

+  (e'-IVI„)(e-M„)F<2>  (1) 

where  e  and  e'  are  the  polarization  vectors  of 
the  incident  and  scattered  x-rays,  respective¬ 
ly,  and  M,,  is  the  unit  vector  along  the  mag¬ 
netization  direction  in  the  sample.  The  com¬ 
plex  factors  describe  the  atomic  resonant 
excitation  and  decay  processes,  and  they  can 
be  expanded  in  terms  of  multipole  moments 
of  the  ground  state  (6).  The  first  term  in  Eq. 
1  is  due  to  scattering  from  the  Fe  charge 
distribution,  whereas  the  latter  two  terms  are 
purely  magnetic  scattering  contributions.  In 
the  following  we  use  the  second  term  in  Eq. 
1  to  reconstruct  the  magnetization  profile  of 
the  film.  The  difficulty  with  this  is  that  usu¬ 
ally  the  absolute  magnitude  of  the  complex 
factors  is  not  very  well  known  and  can 
only  be  obtained  directly  under  certain  con¬ 
ditions,  such  as  for  multilayered  samples  (7, 
5).  However,  the  case  of  regular  domain  pat¬ 
terns  results  in  an  elegant  way  to  separate  the 
three  scattering  contributions  in  Eq.  1.  The 
lateral  domain  periodicity  leads  to  purely 
magnetic  superstructure  scattering  peaks  lo¬ 
cated  symmetrically  around  the  specularly 
reflected  x-ray  beam.  For  structurally  well- 
ordered  films  with  smooth  interfaces,  the 
charge  scattering  term  in  Eq.  1  contributes 
only  to  the  specular  peak.  The  two  magnetic 
terms  are  linear  and  quadratic  in  and 
cause  magnetic  peaks  at  wave  vectors  ±t  and 
±2t,  respectively  (2pi/T  is  the  domain  peri¬ 
odicity)  (J“5). 

To  assess  the  scattering  from  the  individ¬ 
ual  domains  in  Fig.  IB,  we  must  determine 
the  scattering  cross  sections  for  the  x-ray 
polarization  components  a  and  ir  that  are 
perpendicular  and  parallel  to  the  scattering 
plane,  respectively  (P).  For  the  scattering  ge¬ 
ometry  used  (Fig.  2 A)  and  concentrating  on 
the  second  term  in  Eq.  1 ,  there  are  mainly  two 
scattering  paths  producing  ir-polarized  scat¬ 
tered  light  (4).  For  the  bulk  domains,  is 
perpendicular  to  the  film  and  cr-polarized  in¬ 
cident  radiation  experiences  a  Faraday  rota- 
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CHAPTER  1 


INTRODUCTION 


Conventionally,  imaging  systems  seek  to  to  implement  pointwise  mappings  from 
a  source  space  onto  a  measurement  space.  Since  hyperspectral  systems  may  involve 
five  dimensional  spatial,  spectral  and  temporal  source  spaces,  the  sensor  data  load  in 
such  systems  is  often  enormous  and  untenable.  Here,  I’ll  explore  optical  design  and 
sensor  head  processing  to  reduce  this  data  load  for  sparse  source  spaces.  Our  sources 
consist  of  one  or  a  few  point  sources  distributed  in  five  dimensional  space. 

For  such  sources,  acquisition  of  the  full  pointwise  source  map  is  enormously  inef¬ 
ficient.  To  avoid  this  data  load,  one  seeks  to  build  sensors  that  allow  efficient  com¬ 
putation  of  relevant  source  variables,  such  as  position  and  spectral  radiance,  without 
building  a  full  reconstruction  of  the  source  space. 

I  focus  on  the  rotational  shear  interferometer  (RSI).  Originally  used  to  measure 
abberations  [1],  the  RSI  mixes  spectral  and  spatial  source  data  on  a  single  sensor 
plane.  The  recent  trend  toward  ubiquitous  computational  power  and  better  sensors  for 
both  visible  and  infrared  light  make  it  possible  to  take  advantage  of  the  way  the  RSI 
projects  the  source  space  onto  a  sensor  plane.  Computational  analysis  can  be  used  to 
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process  the  RSI  sensor’s  data  in  many  ways.  My  colleagues  in  the  Photonic  Systems 
Group  have  previously  shown  that  RSI  imaging  can  be  used  for  tomographic  3D 
reconstruction  and  spatio-spectral  imaging  [2].  Previously,  Itoh,  Ihoue,  and  Ichioka  [3, 
4',  5,  6]  constructed  an  RSI  for  the  purpose  of  taking  a  64x64  image  with  64  channels 
of  spectral  information.  This  was  done  by  dithering  one  arm  of  the  interferometer 
and  capturing  64  two  dimensional  64x64  samples  of  the  mutual  coherence  measured 
on  the  CCD.  The  spectral  image  was  retrieved  by  performing  a  3D  Fourier  Transform 
on  the  64x64x64  dataset. 

As  a  simplification  to  such  a  large  dataset,  I  have  used  the  RSI  to  measure  a 
particular  projection  of  this  spatio-spectral  space  particularly  suited  for  a  sparse  array 
of  point  sources.  In  particular,  each  point  maps  to  a  streak  on  the  sensor  plane  with 
the  angle  of  the  streak  being  the  direction  to  the  source,  and  the  intensity  along 
the  streak  being  the  spectrum.  A  second  measurement  can  be  taken  at  a  different 
angle  to  numerically  calibrate  these  measurements.  In  this  thesis,  simple  algorithms 
are  developed  that  are  more  appropriate  for  estimation  of  these  source  parameters  in 
real-time  situations  with  a  low-power  on-board  processor. 

Coherence  imaging,  as  implemented  on  the  RSI,  has  many  potential  advantages 
over  focal  imaging,  including  robustness  against  abberation  and  high  depth  of  field. 
In  conventional  systems  there  is  a  trade-off  between  resolution  and  depth  of  field  (the 
aperture  must  be  reduced  to  obtain  high  depth  of  field,  which  reduces  resolution  — 
the  pinhole  camera  being  an  extreme  example.)  RSI  systems  obtain  unlimited  depth 
of  field  at  all  apertures,  thereby  removing  this  trade  off. 
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The  trade  off  in  coherence  systems  is  instead  between  source  complexity  and  sig¬ 
nal  to  noise.  Complex  sources  produce  high  interferometric  shot  noise,  degrading  the 
reconstructed  image.  One  may  stop  down  the  effective  aperture  in  an  RSI  to  de¬ 
grade  source  resolution  and  decrease  the  number  of  effective  source  channels,  thereby 
establishing  a  tradeoff  between  resolution  and  source  complexity. 

In  view  of  this  trade-off,  coherence  imaging  is  most  attractive  for  tracking  low 
complexity  sparse  sources.  In  this  application,  the  combination  of  resolution  and 
depth  of  field  is  unparalleled.  Tracking  and  analysis  of  arrays  of  flying  point  sources 
is  an  example  application  for  this  approach.  I  will  first  describe  the  theory  behind 
the  operation  of  the  RSI,  with  emphasis  on  determining  the  location  and  spectrum 
of  point  sources.  I  will  then  describe  the  construction  of  the  Portable  RSI,  which 
combines  a  stable  RSI  with  the  electronics,  processing,  and  wireless  networking  nec¬ 
essary  to  use  it  as  a  stand-alone  RSI  data  acquisition  system.  In  the  fourth  chapter, 
I  discuss  experimental  results  of  using  the  visible  RSI  for  determining  the  location 
and  wavelength  of  a  laser  spot  made  by  combining  two  different  lasers  onto  the  same 
point.  Then  I  will  motivate  the  use  of  infrared  (IR)  with  a  chapter  on  IR  theory  as  it 
applies  to  the  RSI.  Finally  I  will  describe  how  the  Portable  RSI  was  used  for  tracking 
IR  sources. 
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CHAPTER  2 


RSI  POINT  SOURCE  THEORY 

2.1  Introduction 

The  fringe  pattern  recorded  on  the  RSI’s  CCD  changes  in  the  same  way  if  the 
object’s  angle  with  respect  to  the  optical  axis  doubles  or  if  the  wavelength  is  cut  in 
half,  which  will  be  proven  and  experimentally  demonstrated  in  the  sections  to  come. 
It  is  possible  to  determine  a  wavelength-calibrated  power  spectral  density  by  rotating 
the  interferometer  a  known  amount  and  taking  a  second  image. 

Here  I  postulate  that  the  source  is  constrained  to  be  a  point  radiating  at  a  specific 
wavelength  and  explain  a  scheme  for  determining  the  angular  position  and  wavelength 
in  just  two  2D  CCD  measurements.  We  then  extend  this  scheme  to  include  point 
sources  with  discrete  and  continuous  spectra  and  then  sparse  arrays  of  such  sources. 

This  treatment  is  by  no  means  as  general  as  those  dealing  with  measurement  of  the 
3D  mutual  coherence  function,  but  the  simplification  in  both  hardware  accuracy  and 
amount  of  computation  makes  this  scheme  useful  where  its  assumptions  are  valid. 
This  is  especially  true  in  the  infrared  where  one  is  often  very  concerned  with  the 
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spatial  and  spectral  information  in  a  scarcely  populated  scene  using  relatively  noisy 
detectors. 

2.2  RSI  Theory  and  Design 

For  simplicity  we  first  consider  a  simple  point  source  emitting  at  a  single  wave¬ 
length  A.  The  phase  of  the  complex  analytic  field  changes  by  2'n  when  measured 
one  wavelength  farther  away  in  any  direction.  The  complex  analytic  field  emitted  by 
this  point  source  is  a  spherical  wave  [7]  and  is  given  in  equation  (2.1)  where  r  is  the 
distance  to  the  point  source. 

E{r)  =  (2.1) 


In  the  RSI  pictured  in  Fig.  2.1,  the  source  is  represented  as  a  teapot  for  visual 
clarity,  whereas  the  source  in  this  discussion  is  a  single  point.  The  field  at  the  CCD 
is  the  sum  of  the  fields  reflected  off  the  mirrors  in  each  arm. 

We  assume  the  amplitudes  of  the  two  fields  are  approximately  the  same  at  the 
CCD  and  from  now  on  I  neglect  the  overall  amplitude  scale.  With  ri  and  r2  being  the 
distances  from  a  pixel  of  the  CCD  to  the  point  source  through  the  first  and  second 
arms  of  the  interferometer,  the  field  at  the  CCD  through  the  RSI  becomes 


i27r^  I  ^{277^ 


(2.2) 


The  normalized  intensity  measured  is  then  given  by  the  magnitude  squared  of  this 
field  —  a  constant  plus  a  co-sinusoidal  modulation  term. 


I  oc  -1- A 
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Figure  2.1:  RSI  with  Right  Angle  Mirrors.  Note  handedness  of  reflections. 


oc 

(X 

(2.3) 

(X 

2  +  2COS  (^^(d  -’"2)^ 

(2.4) 

The  geometry  of  the  RSI  determines  ri  and  r2.  Instead  of  an  RSI,  to  begin  with, 
consider  a  Michelson  Interferometer  as  shown  in  Fig.  2.2  with  flat  mirrors  instead  of 
the  RSI’s  right  angle  mirrors. 

Specifically,  we  want  to  calculate  the  intensity  measured  on  a  CCD  pixel  at  {xc,  Vc) 
for  a  point  source  at  (Xg,  Vs)  a  distance  2:  away  where  z  includes  the  distance  through 
the  arms  of  the  interferometer.  These  measurements  are  labelled  in  Fig.  2.2.  By 
’’unfolding”  the  interferometer,  one  can  see  that  these  distances  are  given  by  the 
simple  Pythagorean  relations  in  equations  (2.5)  and  (2.6). 

n  =  V +  (Vc  -  Vsf  +  (2.5) 
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Figure  2.2;  Picture  of  3D  Michelson  Interferometer 

r2  =  {Xc  -  Xsf  +  iVc  -Vsf  +  (2-6) 

Now  consider  the  effect  of  the  right  angle  mirrors  as  shown  in  the  RSI  pictured  in 
Fig.  2.1,  one  rotated  by  angle  6  and  the  other  by  angle  —0.  When  you  look  at  yourself 
in  a  right  angle  mirror,  you  look  like  you’ve  been  flipped  across  the  right  angle  vertex 
of  the  mirror.  If  the  right  angle  was  vertical  {0  =  0°),  your  image  will  the  flipped 
right-to-left  as  compared  to  your  image  in  a  flat  mirror.  Text  through  the  mirror  will 
be  readable  since  the  double  reflection  preserves  handedness.  If  you  looked  at  yourself 
through  right  angle  mirrors  with  the  right  angle  horizontal  {0  =  90°),  you  would  look 
upside-down  (rotated  by  180°).  For  an  arbitrary  angle,  you  look  rotated  by  20,  which 
is  somewhat  intuitive  since  when  we  turn  the  prism  from  6*  =  0°  to  0  =  90°,  we  have 
to  go  from  right-side-up  to  up-side-down  in  some  continuous  way.  Fig.  2.3  is  a  picture 
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taken  through  a  right  angle  mirror  at  an  angle  oi  0  =  45°  and  thus  a  “rotation”  of 


26  =  90°.  Note  the  non-inverted  text  of  “Kodak”  on  the  camera. 


Figure  2.3:  Looking  into  a  mirror  at  45°. 

We  now  consider  the  affect  these  right  angle  mirrors  have  of  fields  coming  from 
the  source.  In  Fig.  2.1,  a  right-handed  coordinate  system  is  assigned  to  the  source 
with  the  z  axis  pointing  in  the  direction  of  light  propagation.  The  effect  of  the  beam 
splitter  and  mirrors  on  the  source  coordinates  is  shown  after  each  optical  element 
for  both  paths.  A  reflection  off  of  the  beam  splitter  changes  the  handedness  of  the 
coordinate  system,  whereas  a  reflection  off  of  a  right  angle  mirror  changes  the  direction 
of  propagation  and  rotates  around  the  axis,  but  through  reflections  off  of  each  face, 
it  restores  the  handedness  of  the  coordinate  system.  The  overall  effect  can  be  seen 
in  a  picture  through  an  actual  RSI  as  shown  in  Fig.  2.4  where  one  mirror  is  vertical 
and  the  other  mirror  is  slightly  rotated. 
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Figure  2.4:  Picture  of  a  “Source” ,  and  tl^i^hource  through  the  RSI. 


To  write  this  down  analytically,  we  first  consider  having  no  shear  (0  =  0°) 
where  the  right  angle  of  the  mirror  runs  along  the  y-axis.  If  you  look  through  either 
arm  of  the  interferometer,  the  right  angle  mirror  has  the  effect  of  making  the  source 
at  (xs,t/s)  appear  at  the  same  place  as  a  point  at  {—Xs.ys)  would  be  through  the 
Michelson  Interferometer.  We  define  (xi,?/i)  in  the  following  way:  When  we  look 
at  a  point  source  at  (xj,  yg)  through  arm  1  of  the  RSI,  it  looks  like  it  would  be  at 
(^i?yi)  if  we  had  been  looking  through  a  Michelson  Interferometer.  Similarly,  if  we 
were  looking  through  arm  2,  the  point  source  looks  like  it’s  at  (x2,  ^2)-  For  no  sheer, 
i^i,yi)  =  (3^2,02)  =  i-Xs,ys)-  For  arbitrary  shears  -6  in  arm  1  and  0  in  arm  2, 
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Xi 

UJ  V 
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(2.7) 
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The  quantities  we  are  interested  in  are  ri  and  r2  given  in  equations  (2.5)  and  (2.6), 
but  with  {xs,ys)  as  seen  through  the  flat  mirror  interferometer  replaced  by  {xi,yi) 
and  (x2,  ^2)  flae  to  the  effect  of  the  rotated  right  angle  mirrors: 


n  =  \l  {xc  -  xif  +  {yc  -  yif  +  (2.9) 

r2  =  V {xc  -  xif  +  {yc  -  y\f  +  ^2  (2.10) 


To  find  the  intensity  of  light  on  the  CCD,  we  substitute  these  values  for  ri  and  r2 
into  equation  (2.4): 


I  a  2  +  2  cos 


J'2 


/ 


oc  2  +  2  cos 


27r 

X 


( 


1/ {xc  -  Xif  +  {yc  -  yif  + 


(2.11) 

(2.12) 


y  y  ^ (xc  -  X2f  +  {yc  -  t/2)^  +  )  ) 

At  this  point,  we  make  the  approximation  that  the  distance  to  the  source  z  is  much 
farther  than  the  distance  that  the  object  is  off  axis: 


(Xc  -  x,f  +  (j/c  -  9,)^  < 


(2.13) 


A  Taylor  Expansion  of  the  first  square  root  in  equation  (2.12)  for  this  large  2:  with 
only  the  first  order  terms  kept  is  shown  in  equation  2.14.  A  similar  expression  holds 
for  the  second  square  root. 


(2.14) 


Substituting  this  approximation  back  into  equation  (2.12): 

..  \2 


/  oc  2  +  2  cos  f  ^  f + 


(Xc-Xi)  ^-{yc-yi)  {Xc-X2)  +(?/c-?/2)' 

- 2 - 


2z 


2z 


(2.15) 
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Now  using  equations  (2.7)  and  (2.8)  to  substitute  for  {xi,yi)  and  (^2,^2)  and  doing 
trigonometry  simplification,  we  arrive  at  the  RSI  point  source  equation  for  the  inten¬ 
sity  measured  on  a  CCD  pixel  at  {xc,  Uc)  for  a  point  source  at  a  distance  z,  radiating 
with  wavelength  A,  and  for  a  shear  angle  set  at  9: 

T  r.  r.  /47rsin(2^).  A  . 

/  oc  2  -I-  2  cos  ( - — — -  {xsVc  +  ysXc)  j  (2.16) 


Since  we  are  only  interested  in  the  direction  to  the  source  and  not  its  absolute 
position,  we  consider  and  py,  the  angles  from  the  z-axis  of  the  RSI  out  to  the 
point  source  in  the  x  and  y  directions.  With  tan(0i)  =  Xg/z  and  taxi(py)  =  yg/z, 
the  expression  for  intensity  in  equation  (2.16)  becomes 

'  Air  sin  {29) 


7  oc  2  -t-  2  cos 


A 


(tan  (^3.)  yc  -|-  tan  {py)  x^) 


(2.17) 


2.3  NumericcJ  Simulation  of  RSI’s  CCD 

As  an  example,  for  a  point  source  located  10m  away  at  (20.5mm,  30.5mm),  mirror 
shear  angle  9  =  10°,  wavelength  A  =  500nm,  Fig.  2.6  shows  what  is  measured  on  a 
200  X  200  pixel,  1cm  x  1cm  CCD  along  with  its  2D  Fourier  Transform. 

2.4  Separating  the  Spatial  and  Spectral 
Information 

As  discussed  elsewhere,  this  RSI  pattern  is  a  measurement  of  the  mutual  coherence. 
When  the  goal  was  to  reconstruct  an  image  via  the  van  Cittert-Zernikie  Theorem, 
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the  Fourier  Transform  of  the  CCD  intensity  gives  you  projections  through  the  image. 
This  is  why  the  Fourier  transform  pictured  is  a  single  point  along  with  a  central  DC 
spot.  The  DC  spot  comes  from  the  first,  constant  term  in  equation  (2.17). 

Effects  of  changing  angular  position  and  wavelength  are  shown  in  the  fourier 
transform  in  Fig  2.6.  It’s  apparent  from  the  intensity  equation  that  angular  positions 
are  indistinguishable  from  wavelength  in  a  single  measurement.  Moving  the  object 
twice  as  far  away  (thus  reducing  tan  {(f)^)  and  tan  {(f)y)  by  a  factor  of  two)  has  the  same 
effect  on  the  fringe  pattern  as  doubling  the  wavelength.  To  break  this  degeneracy  and 
find  the  location  and  wavelength  a  monochromatic  point  source,  one  can  first  take 
a  measurement  with  the  RSI  at  some  unknown,  but  desired  angle  (j)x  with  respect 
to  the  source.  Then  one  can  rotate  the  RSI  a  known  angle  and  take  another 
measurement  where  the  RSI  is  at  angle  01  + 

How  do  we  know  from  the  fourier  transform  in  Fig.  2.6  if  the  source  was  at  the 
top-right  or  bottom  left?  Because  the  data  collected  from  the  CCD  is  purely  real,  the 
Fourier  Transform  is  symmetric  and  there  isn’t  any  complex  phase  data  to  distinguish 
the  two  points  in  the  Fourier  Transformed  fringe  pattern.  After  the  rotation,  however, 
it’s  obvious  which  way  the  point  source  moved. 

The  top  half  of  the  two  dimensional  Fourier  Transform  of  the  CCD  measurements 
will  be  a  single  peak  centered  around  one  point  in  Fourier  space  measured  to  be 
{ui,Vi)  for  the  unrotated  measurement  and  {u2,V2)  for  the  rotated  one.  From  RSI 
point  source  equation  (2.17),  one  can  see  that  these  “spatial  frequencies”  correspond 
to  measurements  of  the  angle  and  wavelength.  Note  these  are  not  angular  frequencies, 
so  the  factor  of  2tt  stays  inside  of  the  cosine  as  in  cos  {2Trvx).  These  spatial  frequencies 
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are  given  by 


Vl 


_  2  sin  (20)  tan  (0a;)  ^  ,  2  sin  (20)  tan  (0a- +  A0a:) 

-  an  V2  = 


(2.18) 


This  system  of  two  equations  and  two  unknowns  (tan  (0a;)  and  A)  can  be  solved  by 
expanding  tan  (0a;  +  A0a;)  =  ’  substituting,  and  taking  the  negative 

roots  of  the  resulting  quadratic  equations  since  we  took  the  Fourier  Transform’s  pos¬ 
itive  Vi . 

^  (2.19) 

tan  (0a;)  =  2  tan  ( A0  )  uq  “  V (^i  “  '^2)^  -  4uiU2  tan^  ( A0a;)^  (2.20) 

Though  unappealing,  this  is  a  closed  form  for  both  the  wavelength  and  the  direction  of 
the  point  source  using  no  approximations  other  than  the  initial  Fresnel  approximation 
from  equation  (2.13)  in  deriving  the  RSI  point  source  equation. 

Continuing  the  numerical  example  above,  if  we  rotate  the  RSI  by  A0a;  =  0.1°,  we 
get  the  simulated  CCD  Fourier  Transform  shown  in  Fig.  2.7.  By  a  weighted  average, 
the  pixel  in  the  Fourier  Transform  corresponding  to  the  biggest  intensity  occurs  in 
the  first  Fourier  Transform  where  vi  is  28  and  in  the  second  where  V2  is  52.  Since 
each  pixel  in  the  Discrete  Fourier  Transform  has  a  spatial  bandwidth  of  one  over  the 
size  of  the  CCD, 


28  28  „  o  -1  ,  52 

Vi  =  — — —  =  — - =  2.8mm  and  Ui  =  — ; - = 

ccdszze  10mm  ccdsize 

Substituting  these  values  into  equation  (2.19)  and  (2.20), 
and  0a;  =  0.002036  =  20.36mm/10m. 


- - =  5.2mm~^  (2.21) 

10mm 

one  estimates  A  =  497.5nm 
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Figure  2.7:  Pattern  on  CCD  from  point  source  with  rotated  RSI. 

2.5  Spatial  and  Spectral  Range  and  Resolution 

For  a  single  point  source,  we’ll  consider  “resolution”  to  be  how  well  one  can  esti¬ 
mate  its  wavelength  (A)  and  its  angular  position  {(j)^  and  and  “range”  to  be  the 
maximum  and  minimum  wavelength  and  angles  that  are  measurable  with  a  particu¬ 
lar  shear  angle.  The  resolution  and  range  are  determined  by  the  pixel  size  and  pixel 
count  of  the  CCD. 

Let  the  width  and  height  of  each  pixel  be  and  the  number  of  samples  in  each 
direction  be  N  so  the  total  width  and  height  of  the  CCD  is  ccdsize  =  NAx-  From  the 
Nyquist  Sampling  Theorem,  the  maximum  spatial  frequency  that  can  be  measured 


without  aliasing  by  the  CCD  is  where  maximum  and  minimum  intensities  occur  in 
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adjacent  pixels  as  in  equation  (2.22). 


cos  {2‘KUmaxNAx)  =  COS  (ttN) 


(2.22) 


Prom  this  way  of  looking  at  the  maximum  frequency  that  can  be  sampled,  an  ex¬ 
pression  for  the  maximum  measurable  spatial  frequency  is  given  in  equation  (2.23). 


Umax 


1 


(2.23) 


Because  the  spatial  frequencies  in  the  FFT  image  run  from  —Umax  to  Umax,  the  “size” 
of  each  pixel,  and  thus  the  accuracy  to  which  it  can  be  measured,  is  given  by  Am  in 
equation  (2.24) 


A.= 


2u 


max 


N 


1  _  1 
NAx  ccdsize 


(2.24) 


As  for  range,  looking  at  equation  (2.17)  for  the  fringe  intensity  ,  Umax  and  A^ 
both  apply  to  the  measurement  of  a  combined  quantity  involving  both  position  and 
wavelength. 


2  sin  (29) 


tan  ((^a;)  Umax  — 


2A 


(2.25) 


Since  both  the  resolution  and  range  of  measurements  depend  on  the  shear  angle  0, 
when  the  shear  angle  is  changed,  the  effect  is  to  zoom  in  or  out.  This  can  be  done  to 
maximize  measurement  resolution  while  keeping  the  point  source  within  range. 


2.6  Multiple  Sources 


If  you  had  a  relatively  sparse  array  of  point  sources  at  well-defined  frequencies,  by 
rotating  the  RSI  in  steps  and  tracking  the  positions  of  the  point  sources,  an  accurate 
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measurement  could  be  made  of  the  location  and  wavelength  of  all  of  the  sources.  The 
key  is  to  group  the  points  (for  discrete  spectra)  or  smears  (for  continuous  spectra)  on 
the  Fourier  transformed  RSI  data  into  separate  sources.  This  can  be  done  because  as 
the  RSI  is  rotated  around,  it  will  be  looking  directly  at  each  point  source  whose  data 
will  switch  from  positive  to  negative  frequency. 
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CHAPTER  3 


DESIGN  AND  CONSTRUCTION 
OF  PORTABLE  RSI 

3.1  Design  Criteria 

We  designed  the  portable  RSI  as  unit  that  could  be  plugged  into  the  wall  and 
automatically  run  a  wireless  web-based  interface  for  taking  RSI  and  processing  data. 
This  unit  is  shown  in  Fig.  3.1  and  contains  the  following: 

1.  Optical  and  mechanical  elements  of  a  small,  stable  RSI. 

2.  CCD  camera 

3.  PC104  Pentium  Ill-based  computer  with  a  wireless  Ethernet  card 

4.  Control  electronics,  including 

(a)  Power  supply 

(b)  Rotation  stage  stepper  motor  controller 

(c)  Piezo  translator  combined  with  a  position  sensor  in  a  feedback  circuit  to 
insure  linear  movement  of  one  arm  of  the  interferometer  under  computer 
control. 
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Figure  3.1;  RSI  Module  with  Computer  and  Electronics 


In  one  application,  a  portable  handheld  iPaq  with  a  wireless  ethernet  card  as 
shown  in  Fig.  3.2  runs  a  web  browser  that  talks  to  the  portable  RSI’s  web  scripts. 
The  iPaq  is  a  portable  WinCE-based  computer  with  a  touch-sensitive  screen  that 
using  a  stylus  as  input.  We  use  the  iPaq  to  set  the  shear  angle  and  mirror  position, 
take  images,  view  reconstructions,  and  organize  files.  The  data  continues  to  be  stored 
on  the  PC104  computer  inside  the  portable  RSI,  so  when  further  analysis  is  required, 
the  data  can  be  downloaded  to  a  desktop  PC  through  the  same  web  interface. 

3.2  Optical  and  Mechanical  Elements 

The  portable  RSI  is  designed  to  hold  optics  for  both  visible  light  and  infrared 
centered  around  10/xm.  Because  the  only  right  angle  prisms  available  for  IR  are  lin 
high,  this  is  size  we  chose  for  all  of  the  optics.  For  visible  light,  we  use  a  cube  beam 
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Figure  3.2:  An  iPaq  running  a  web  browser 

splitter  with  an  anti-reflection  (AR)  coating.  The  high  precision  right  angle  prisms 
are  AR  coated  on  the  hypotenuse  and  aluminum  coated  on  the  legs.  All  visible  optics 
were  purchased  from  Melles  Griot.  There  are  no  cube  beam  splitters  for  lO^m  IR, 
so  a  custom  plate  beam  splitter  was  constructed  and  mounted  on  a  quartz  square 
by  Janos  Technologies,  from  whom  the  Aluminum  coated  IR  right  angle  prisms  were 
also  purchased. 

Ron  Stack  and  Chuck  Henderson  contributed  significantly  to  the  design  of  the 
mechanical  elements.  In  order  to  keep  temperature  fluctuations  from  affecting  the 
alignment  of  the  RSI,  the  metal  alloy  Invar  was  used  wherever  possible  due  to  its 
superior  thermal  stability.  All  of  the  parts  were  machined  by  the  ECE  machine  shop. 

One  goal  of  the  portable  RSI  was  to  have  accurate  computer  control  over  the 
shear  angle.  This  had  never  been  done  in  any  of  the  interferometers  that  our  group 


had  constructed.  Typically  rotating  one  of  the  right  angle  prisms  to  change  the  shear 
angle  is  done  by  hand  and  required  realigning  parts  of  the  RSI  afterward.  Having 
automatic  rotation  without  recalibration  required  extremely  precise  alignment  of  the 
optics.  In  addition  to  being  highly  accurate,  the  rotation  stage  we  chose  had  to  be 
very  compact.  We  decided  on  the  Newport  PR50PP  rotation  stage,  which  has  a 
stepper  motor  accurate  to  0.010  degrees. 

In  order  to  change  the  path  length  of  one  arm  of  the  interferometer,  a  Piezo- 
Electric  disk  translator,  Physik  Instrumente  part  P-286.40  is  mounted  on  one  side  of 
the  rotation  stage’s  rotating  screw  hole  as  shown  in  Fig.  3.3.  A  thin  metal  disk  is 
mounted  on  the  other  side  of  the  hole  and  a  rod  connects  their  centers.  The  prism 
holder  is  mounted  onto  that  rod  and  the  whole  assembly  of  disk  translator,  thin  metal 
disk,  rod,  and  prism  holder  rotates  together.  Care  must  be  taken  to  align  the  rod 
with  the  rotation  stage’s  axis  of  rotation,  and  thanks  to  the  ECE  machine  shop,  no 
more  than  .002in  of  wobble  is  present  at  the  end  of  the  rod  as  the  rotation  stage  goes 
through  360  degrees. 

To  achieve  the  sub-micron  alignment  of  the  portable  RSI  required  to  keep  the 
interference  fringes  from  drifting  when  the  computer  rotates  the  prism  or  changes 
the  path  length  with  the  Piezo  Translator,  each  adjustment  must  Ije  made  using 
a  micrometer  translator  rather  than  “by  hand.”  To  achieve  portability,  however, 
these  bulky  screw  micrometers  could  not  be  part  of  the  final  Portable  RSI  design. 
An  external  alignment  mount  is  attached  to  the  RSI  and  the  adjustments  are  made 
using  its  micrometers.  When  fringes  are  found  that  do  not  drift,  the  components  are 
carefully  locked  into  place  using  screws.  The  dove-tail  joint  shown  toward  the  bottom 


21 


Figure  3.3:  Portable  RSI,  Looking  at  Rotation  Stage  and  Piezo  Disk  Translator 

of  Fig.  3.4  that  holds  the  beam  splitter  mount  to  the  rest  of  the  RSI  leaves  room  for 
forward-backward,  side-to-side,  and  twisting  motion  before  being  locked  into  place  by 
the  four  screws  on  the  sides. 

3.3  Alignment 

With  the  beamsplitter  and  fixed  prism  assembly  (BS/prism  holder)  removed,  a 
laser  is  set  up  level  to  the  table  several  meters  away  to  shine  into  the  center  of  the 
rotating  prism.  To  find  the  center,  translate  the  laser  up  and  down  or  back  and 
fourth  until  it  is  always  centered  on  the  back  right  angle  as  the  prism  rotates  around. 
Next,  the  tilt  of  the  rotating  prism  must  be  set.  The  goal  is  to  have  the  beam  always 
retrorefiecting  into  the  laser  no  matter  what  the  rotation  is.  The  complication  here 
is  that  both  the  tilt  of  the  prism  with  respect  to  the  axis  of  rotation  and  the  axis  of 
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Figure  3.4:  Portable  RSI,  looking  at  the  front.  Dovetail  joint  is  on  the  bottom. 

rotation  itself  must  be  aligned  to  the  laser.  For  example,  as  the  prism  rotates,  if  the 
retroreflection  spends  more  time  above  the  laser,  the  rotation  stage’s  axis  is  pointing 
up.  Slips  of  thin  lens  paper  must  be  inserted  under  the  back  RSI  to  slightly  angle  the 
whole  thing  down.  Similarly,  if  the  spot  spends  more  time  to  the  right  of  the  laser, 
the  whole  RSI  must  be  rotated.  Once  the  retroreflected  spot  makes  a  roughly  even 
circle  around  the  laser,  the  adjustment  screws  on  the  prism  mount  itself  must  be  set 
to  reflect  the  spot  back  into  the  laser.  The  height  or  position  of  the  laser  might  have 
to  be  adjusted  slightly  to  keep  it  in  the  center,  and  side  to  side  angle  along  with  the 
slips  of  lens  paper  might  have  to  be  readjusted  to  zero  in  on  the  correct  alignment. 
When  this  part  is  done,  the  rotation  stage  should  be  able  to  turn  360°  while  keeping 
the  laser  perfectly  reflected  into  itself. 
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Next,  the  beam  splitter  and  fixed  prism  must  be  aligned  to  each  other.  Put  a  slip 
of  paper  in  front  of  the  rotating  prism  to  block  it  from  the  laser.  Unscrew  all  of  the 
dove-tail  screws  and  push  the  BS/prism  holder  against  the  side  of  the  dove-tail  to  get 
it  approximately  perpendicular  to  everything  else.  Put  the  beam  splitter  in  the  mount 
and  rotate  it  around  until  the  retroreflection  off  of  its  faces  goes  above  or  below  the 
laser.  Then  lock  it  into  place  with  the  screws  fi'om  above.  The  entire  dove-tail  slider 
can  be  tilted  vertically  with  the  screws  on  the  front  to  get  the  refiection  off  of  the 
faces  to  go  into  the  laser.  Slide  the  BS/prism  holder  perpendicular  to  the  dove-tail 
slider  so  the  laser  is  going  through  approximately  the  center  of  the  beam  splitter  and 
rotate  the  assembly  (not  the  BS  itself)  so  that  the  reflections  off  of  the  BS  face  go 
into  the  laser.  Lock  it  into  place  with  the  screws. 

Next,  put  the  fixed  prism  in  and  slide  it  back  and  fourth  until  the  laser  is  centered 
on  the  back  corner.  Rotate  the  prism  back  and  forth  so  that  the  reflection  off  of  its 
front  face  goes  back  into  the  laser.  The  reflection  off  of  the  anti-reflection  coated  face 
will  be  much  dimmer  than  the  reflection  off  of  the  Aluminum  coated  back,  so  it  might 
be  difficult  to  see. 

Now  the  angles  of  the  RSI  are  all  correct,  and  all  that  remains  is  to  slide  the 
BS/prism  holder  back  and  forth  along  the  dovetail  rail  until  the  path  lengths  of  the 
two  arms  are  identical  to  within  a  few  microns.  Unfortunately,  in  order  to  slide  it 
around,  the  screws  holding  it  to  the  dovetail  rail  have  to  be  loosened  and  the  rotation 
alignment  will  be  lost.  It  would  be  nice  if  we  could  find  the  place  where  the  path 
lengths  are  equal  using  the  laser  so  that  at  each  point  the  reflections  off  the  face  of 
the  beam  splitter  and  fixed  prism  could  be  made  to  point  back  into  the  laser.  The 


24 


best  way  I  know  how  to  find  this  place  is  to  find  the  highest  contrast  fringes  for  white 
light.  The  laser  has  a  very  long  coherence  length,  so  you’ll  get  high  contrast  fringes 
no  matter  what  the  path  length  difference. 

Instead  of  looking  at  the  laser  interference,  shine  white  light  on  an  iris  with  a  pin 
whose  point  is  in  the  center  of  the  laser  beam  (right  along  the  optical  axis  of  the 
RSI.)  Turn  the  laser  off  and  focus  on  the  pin  through  the  RSI  with  a  CCD  camera. 
With  the  shear  angle  set  to  0°,  the  two  images  of  the  iris  and  pin  should  be  on  top  of 
each  other  when  everything  is  aligned  properly.  Even  with  the  CCD  focused  on  the 
pin,  fringes  will  still  appear  when  the  path  lengths  are  equal.  Either  by  hand  or  with 
an  external  translation  stage,  move  the  BS/prism  mount  back  and  forth  until  fringes 
appear,  always  keeping  the  two  images  of  the  pin  on  top  of  each  other.  This  is  the 
part  that  can  take  days.  It  helps  to  put  an  interference  filter  before  the  CCD  so  that 
fringes  appear  over  a  longer  distance,  but  when  the  highest  contrast  fringes  appear 
with  the  filter,  they’ll  also  appear  with  white  light.  It’s  a  good  idea  to  set  the  piezo 
translator  to  the  center  of  its  range  to  put  the  zero-path-length-difference  there. 

3.4  Control  Electronics 

There  were  three  custom  electronics  boards  used  to  control  the  portable  RSI.  The 
first  is  a  power  supply  board  that  takes  an  unregulated  24V  from  either  a  battery 
or  an  AC  to  DC  converter.  Using  a  Lambda  PM3024T0512  regulator,  this  board 
outputs  -I-5V,  -f-12V,  and  -12V,  which  are  routed  to  the  PC104  computer  and  the 
other  electronics  boards. 


25 


Figure  3.5:  Power  Supply  Printed  Circuit  Board 

The  rotation  stage  stepper  motor  controller  board  takes  both  parallel  port  data 
and  push-button  switches  as  input.  This  input  is  looked  at  by  a  Microchip  PIC16F84 
microcontroller  that  then  generates  the  logic  sequence  to  activate  the  two  coils  of  the 
stepper  motor  in  sequence.  These  logic  levels  go  to  ST  PBL3717A  stepper  motor 
driver  chips  that  apply  12V  to  the  coils  with  the  appropriate  polarity.  Using  the 
parallel  port,  the  PC104  computer  or  an  external  computer  can  control  the  stepper 
motor  to  an  accuracy  of  0.010  degrees. 

The  purpose  of  the  feedback  board  is  to  look  at  the  input  and  do  whatever  it 
has  to  do  to  the  piezo  translator  until  the  sensor  matches  the  desired  input.  The 
reason  the  sensor  is  used  at  all  is  that  the  position  of  the  piezo  disk  translaor  is  not 
completely  linear  with  respect  to  the  input  voltage.  It  is  also  subject  to  historesis, 
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Figure  3.6:  Stepper  Motor  Controller  Printed  Circuit  Board 

where  after  moving  around  for  a  while,  it  won’t  necessarily  return  to  the  same  place 
when  the  same  voltage  is  applied  to  it. 

A  switch  mounted  on  the  case  selects  the  input  to  the  piezo  feedback  board,  which 
takes  0-5V.  The  first  setting  selects  the  PC104  computer’s  digital  to  analog  (D  to  A) 
converter,  the  second  selects  an  external  D  to  A  converter,  and  the  last  selects  a 
potentiometer  mounted  to  the  case.  The  feedback  board  also  takes  input  from  a 
Kaman  SMU9000-15N  magnetic  sensor  that  outputs  0-12V  for  positions  from  250/im 
to  350/im  away  from  the  aluminum  cap  on  the  piezo  disk  translator.  For  example,  to 
move  to  the  middle  of  the  range,  an  input  voltage  of  2.5V  is  applied,  and  the  circuit 
would  do  whatever  it  had  to  do  to  get  the  sensor  to  read  6V.  The  circuit’s  output 
goes  to  an  on-board  amplifier  unit  for  the  piezo  translator  that  takes  an  input  voltage 
of  0-5V  and  amplifies  it  to  the  -lOOO-OV  that  the  piezo  requires. 


27 


Piezo  Feedback 
Circuit 
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Vout  (0-5V) 


Figure  3.7;  Piezo  Feedback  Schematic 


Figure  3.8:  Piezo  Feedback  Printed  Circuit  Board 


The  first  part  of  the  circuit  calculates  the  difference  between  the  desired  voltage 
and  the  current  sensor  reading  by  first  scaling  the  sensor’s  0-12V  to  0-5V  and  then 
subtracting  it  from  the  input.  The  second  stage  is  an  integrator  which  integrates  all 
of  these  voltage  differences,  gradually  increasing  or  decreasing  it’s  output  until  the 

j 

voltage  difference  is  at  0,  at  which  point  it  holds  there.  The  final  stage  scales  the 
opamp’s  approximately  -11  to  IIV  swing  to  the  0-5V  rage  required  by  the  on-board 
integrated  piezo  voltage  amplifier. 

3.5  Computer 

The  computer  in  the  portable  RSI  unit  is  a  Pentium  III  PC104  computer  form 
Jumptec.  It  runs  an  in-house  distribution  of  Linux  which  includes  the  Apache  web 
server  for  all  input-output  functionality.  It  has  a  wireless  Ethernet  card  and  a  256MB 
compact  flash  to  hold  the  operating  system  and  the  data. 

The  interfacing  is  done  through  CGI  scripts  accessed  through  web  forms.  Those 
scripts  access  the  parallel  port  for  rotation  stage  control,  the  digital  to  analog  con¬ 
verter  card  for  Piezo  translation  control,  and  the  video  capture  card  to  take  data. 
The  FFT  of  the  2D  captured  fringe  pattern  and  numerical  analysis  of  the  data  can 
be  performed  with  results  returned  through  the  web  interface. 
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CHAPTER  4 


EXPERIMENTAL 

VERIFICATION 


4.1  Setup 

We  used  a  beam  splitter  to  combine  a  HeNe  (A  =  632.8nm)  and  Argon  (A  = 
488. Inm)  laser  of  similar  intensity  onto  rotating  diffuser  (to  eliminate  speckle)  1.8m 
away  from  the  RSI  at  two  different  (px  angles.  A  schematic  of  the  setup  is  shown  in 
Fig.  4.1,  and  a  photo  of  the  experiment  is  shown  in  Fig.  4.2  with  the  rotating  diffuser 
on  the  left  and  the  RSI  on  the  right. 

The  camera  used  was  a  Photometries  cooled  CCD  array  that  was  Im  by  lin  and 
1024x1024  pixels,  making  the  pixel  size  24.8047^m. 

4.2  Results 

Fringes  captured  for  two  different  x  positions  with  2  =  180cm  in  Fig.  4.3. 

Matlab’s  Fast  Fourier  Transform  (FFT)  of  the  fringes  is  shown  in  Fig.  4.4.  The 
very  lowest  frequencies  were  zeroed  out  to  remove  much  of  the  background  noise.  Even 
though  the  lasers  were  combined  into  one  spot,  their  different  wavelengths  caused  the 
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Figure  4.2:  Photo  of  Experimental  Setup 
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While  all  of  the  theory  in  this  paper  was  simplified  using  one  mirror  rotated  6 
and  the  other  rotated  —9,  for  cost  and  ease  of  construction,  the  physical  RSI  has  one 
fixed  mirror  and  one  mirror  rotated  an  angle  29.  This  means  that  with  respect  to  the 
hypothetical  CCD,  the  actual  CCD  is  rotated  an  angle  0,  which  must  be  compensated 
for  by  rotating  either  the  fringe  pattern  before  fourier  transforming,  or  rotating  the 
data  points  after  they  are  found  in  the  fourier  transform.  The  shear  angle  of  the 
RSI  was  set  to  2^  =  4°.  I  chose  to  rotate  the  FFT  data  points  since  resampling  the 
captured  fringe  pattern  before  the  fourier  transform  could  introduce  errors  into  the 
fourier  components  of  the  image.  When  the  data  is  thus  rotated,  the  FFT  points  in 
Fig.  4.4  match  those  predicted  by  equation  (2.17). 
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CHAPTER  5 

INFRARED  SOURCES 


5.1  Black  Body  Radiation 

Objects  at  a  given  temperature  emit  light  with  a  spectrum  roughly  of  a  Black  Body 
with  surface  properties  like  reflectiveness  causing  deviations  from  this  ideal  spectrum. 
The  equation  [8]  for  the  intensity  at  a  given  temperature  is: 

2iTh(P'  (  \  \ 


1  = 


A5 


he 

>XkFtT  _  ^ 


(6.1) 


This  spectrum  is  plotted  for  various  temperature  in  Fig.  5.1.  For  military  and  other 
reasons,  it  is  convenient  to  look  at  thermally  luminous  objects  at  lOum. 


5.2  Radiosity 


The  study  of  how  a  given  object  with  a  given  temperature  distribution  emits  in¬ 
coherent  light  in  different  directions  is  called  radiosity.  The  main  equation  in  radios- 
ity  [8],  equation  (5.2),  calculates  the  radiation  intensity  emitted  by  a  source  of  area 
As  at  temperature  T  a  distance  r  away  from  a  detector  with  area  A^.  The  source’s 
normal  points  an  angle  6s  with  respect  to  the  vector  r  from  the  source  to  the  detector. 
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Intensity  of  Black  Body  Radiation 


Figure  5.1:  Black  body  spectrum  for  different  temperatures. 

and  similarly  an  angle  dd  being  the  angle  from  the  detector’s  normal  to  r.  These  are 
labelled  in  Fig.  5.2. 


j  ^  As  cos  {es)AdCos  jOd)  2) 

r 

5.3  Radiosity  Calculator 

I  wrote  a  program  that  takes  as  input  a  3D  model  of  an  object  where  each  polygon  in 
the  model  can  be  assigned  a  given  temperature.  The  program  calculates  the  intensity 
of  light  in  a  given  wavelength  range  as  seen  by  a  simple  polygon  detector  a  given 
distance  away  and  in  a  given  orientation.  Fig.  5.3(a)  shows  the  program  running  with 
a  model  of  a  plane  as  input,  with  each  surface  of  the  plane  at  the  same  temperature. 
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3.  r 


Figure  5.2:  Diagram  for  Radiosity  Equation 


Fig.  5.3(b)  shows  the  intensity  of  light  incident  on  a  sphere  of  triangle  detectors  in 
the  same  orientation  as  the  plane.  Notice  that  more  radiation  is  detected  above  the 
flat  top  of  the  plane  than  in  front  of  the  nose.  This  is  because  more  area  of  the  plane 
faces  up  than  forward. 


'  IR  Sphere 


■  IR  Sphere 


Figure  5.3:  Radiosity  Calculation  Program:  (a)  Model  (b)  Detector 
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My  initial  version  does  not  account  for  obstructions,  so  in  the  previous  example, 
if  you  were  looking  at  the  plane  in  such  a  way  that  the  wing  was  blocking  part  of 
the  body,  radiation  from  both  the  wing  and  the  body  would  be  counted.  It  does, 
however,  take  into  account  that  polygons  facing  in  the  opposite  direction  should  not 
contribute  to  the  total  intensity,  so  the  program  is  accurate  for  a  convex  object  where 
there  are  no  obstructing  parts  of  the  model. 

In  the  future,  this  program  will  be  used  to  estimate  the  amount  of  IR  radiation 
from  different  objects  for  use  in  modelling  sources  for  the  IR  RSI.  A  future  addition 
to  the  program  would  calculate  the  fringe  pattern  seen  by  the  IR  RSI’s  detector  for 
a  given  source  with  pieces  at  given  temperatures. 
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CHAPTER  6 


INFRARED  RSI 


6.1  Construction  of  the  IR  RSI 

The  IR  RSI  used  custom  optics  from  Janos  technologies.  Their  ZnSe  right  angle 
prisms  were  coated  on  the  legs  with  tin  and  on  the  hypotenuse  with  anti-reflective 
coating  for  10/mi.  I  requested  that  Janos  glue  two  of  these  right  angle  prisms  together 
to  form  a  cube  beam  splitter,  but  their  engineers  claimed  there  was  no  glue  that  was 
transparent  at  10//m.  Instead  they  mounted  one  of  their  planar  beam  splitters  on  a 
lin  by  lin  square  so  that  it  would  fit  right  into  the  portable  RSI.  The  Portable  RSI 
equipped  with  the  custom  prisms  and  beam  splitter  is  shown  in  Fig.  6. 1 

As  with  the  visible  RSI,  for  alignment  I  illuminated  a  pin  and  looked  through  the 
IR  RSI  with  and  IR  camera,  moving  the  beam  splitter  and  prism  assembly  back  and 
fourth  until  I  saw  fringes  while  always  keeping  the  two  images  of  the  pin  on  top  of 
each  other.  Fig.  6.2  shows  IR  fringes  with  the  alignment  pin  in  focus. 

For  a  source,  I  first  tried  a  25W  power  resistor  that  was  painted  dark  brown. 
The  darker  the  color,  the  more  radiation  it  absorbs,  and  more  importantly,  the  more 
radiation  it  emits.  This  was  not  bright  enough,  and  from  the  black  body  radiation 


38 


curves  in  Fig.  5.1,  it’s  clear  that  as  temperature  increases,  the  intensity  at  all  wave¬ 
lengths  continues  to  increase,  even  though  the  peak  intensity  moves  to  shorter  and 
shorter  wavelengths.  For  this  reason,  the  filament  of  a  halogen  light  was  used  since 
its  temperature  is  near  that  of  the  surface  of  the  sun  —  around  4500K. 

The  detector  we  used  a  microbolometer  array  present  in  Indigo  System’s  Merlin 
Camera.  The  camera  has  a  320  by  200  detector  array  and  both  NTSC  and  12-bit 
dynamic  range  digital  output.  To  capture  the  digital  output,  a  Bitflow  Roadrunner 
board  was  used,  and  custom  driver  was  written  for  our  in-house  ImageKitchen  video 
capture  scripting  software. 
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CHAPTER  7 


CONCLUSION 


For  the  situation  where  the  source  is  composed  of  a  few  points,  the  RSI  is  a  useful 
tool  for  estimating  their  location  and  spectra.  Since  there  is  no  image-forming  lens 
in  an  RSI  system,  the  location  and  spectra  of  both  sources  that  are  near  and  sources 
that  are  far  can  be  estimated  equally  well. 

The  Portable  RSI  includes  mechanical  and  optical  elements,  custom  electronics, 
and  a  small  computer  with  a  wireless  networking  card.  Using  a  hand-held  iPaq 
computer  for  control  over  the  data  taking  process,  the  Portable  RSI  simplified  exper¬ 
imental  verification  of  my  point-source  triangulation  technique. 

With  the  use  of  infrared  optics  and  a  microbolometer  array,  information  about 
infrared  point  sources  can  be  tracked.  This  is  especially  useful  for  tracking  distant, 
thermally  luminous  sources  whose  infrared  spectra  in  determine  their  identity. 
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Three-dimensional  coherence 
imaging  in  the  Fresnel  domain 


Daniel  L.  Marks,  Ronald  A.  Stack,  and  David  J.  Brady 


We  show  that  three-dimensional  incoherent  primary  sources  can  be  reconstructed  from  finite-aperture 
Fresnel-zone  mutual  intensity  measurements  by  means  of  coordinate  and  Fourier  transformation.  The 
spatial  bandpass  and  impulse  response  for  three-dimensional  imaging  that  result  from  use  of  this 
approach  are  derived.  The  transverse  and  longitudinal  resolutions  are  evaluated  as  functions  of  aper¬ 
ture  size  and  source  distance.  The  longitudinal  resolution  of  three-dimensional  coherence  imaging  falls 
inversely  with  the  square  of  the  source  distance  in  both  the  Fresnel  and  Fraunhofer  zones.  We  exper¬ 
imentally  measure  the  three-dimensional  point-spread  function  by  using  a  rotational  shear  interferom¬ 
eter.  ©  1999  Optical  Society  of  America 

OCIS  codes:  030.1640,  110.1650,  110.4850,  100.3010,  100.6890,  070.4550. 


1.  Introduction 

Improvements  in  electronic  sensors,  automated  po¬ 
sitioning  systems,  and  data  processing  equipment 
render  optical  coherence  imaging  of  complex  three- 
dimensional  (3D)  objects  increasingly  practical. 
Two-dimensional  (2D)  imaging  based  on  the  far-field 
van  Cittert-Zemike  theorem  has  been  used  in  radio 
astronomy  for  more  than  two  decades. ^  Recently, 
coherence  imaging  techniques  have  begun  to  shift 
back  to  the  optical  domain, and  a  number  of  optical 
systems  have  been  implemented  or  are  under  devel¬ 
opment.^ 

Several  researchers  have  generalized  the  van 
Cittert-Zemike  theorem  to  3D  source  distributions 
and  have  shown  that  3D  inversion  is  possible  in  the 
far  field.^>6  LaHaie’^  describes  modal  3D  reconstruc¬ 
tion  techniques  that  also  work  in  the  near  and 
Fresnel  zones.  Zarubin  notes  that  the  3D  general¬ 
ized  van  Cittert-Zemike  theorem  applies  in  the 
Fresnel  zone  under  certain  coherence  assumptions 
and  that  the  theorem  can  also  be  applied  to  x-ray  and 
particle  scattering.®  More  recently,  3D  source  re- 
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constmction  from  a  finite  far-field  aperture  by  use  of 
the  generalized  3D  theorem  was  analyzed  and  exper¬ 
imentally  demonstrated.®-ii  Unlike  pseudo-3D 
techniques  such  as  holography  and  stereo  imaging, 
coherence  imaging  provides  a  tme  3D  model  of  object 
sources. 

In  this  paper  we  show  that  Fourier  reconstruction 
techniques  can  be  applied  to  Fresnel-zone  reconstmc- 
tion  by  application  of  a  coordinate  transformation  to 
the  generalized  van  Cittert-Zemike  theorem.  This 
extension  is  important  because  the  object  distance 
may  be  much  less  for  a  given  aperture  and  wave¬ 
length  in  the  Fresnel  zone  than  in  the  Fraunhofer 
zone.  Because  longitudinal  resolution  falls  as  the 
square  of  object  distance,  longitudinal  resolution  in 
the  Fresnel  zone  may  exceed  longitudinal  resolution 
in  the  Fraunhofer  zone  by  several  orders  of  magnitude. 

In  Section  2  of  this  paper  we  review  the  Fourier- 
transform  relationship  between  the  source  intensity 
distribution  and  the  far-field  mutual  intensity  and 
describe  the  coordinate  transformation  by  which  a 
similar  relationship  is  obtained  between  the  source 
distribution  and  the  Fresnel-zone  mutual  intensity. 
In  Section  3  we  explore  the  bandpass  and  resolution 
limits  of  3D  coherence  imaging.  Resolution  con¬ 
straints  are  easily  visualized  by  use  of  the  3D  spatial 
bandpass,  or  band  volume,  because  in  limited- 
aperture  systems  the  band  volume  has  precise 
boundaries. ^2,13  Th0  resolution  along  any  given  di¬ 
rection  is  inversely  proportional  to  the  extent  of  the 
band  volume  along  that  direction.  In  Section  3  we 
analyze  the  band  volume  and  the  impulse  response 
for  two  particular  coherence  measurement  systems. 
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Fig.  1,  Measurement  geometry  for  coherence  imaging.  An  inco¬ 
herent  primary  source  distribution  in  the  source  volume  is  imaged 
by  use  of  two-point  correlation  measurements  drawn  from  the 
correlation  plane.  The  separation  between  the  volumes  is  greater 
than  the  extent  of  either  volume.  The  correlation  point  coordi¬ 
nates  are  for  the  first  point  and  {x2,  y2)  for  the  second  point. 

The  correlation  points  are  scanned  throughout  the  correlation 
plane  to  jdeld  the  mutual  intensity,  r^,  r2,  vectors  from  the  source 
volume  origin  to  (xi,  y i)  and  {x2,  y^)]  Si,  S2>  vectors  parallel  to 
Ti  and  Fg;  r^,  position  vector  in  the  source  volume. 


the  Michelson  stellar  interferometer  and  the  rota¬ 
tional  shear  interferometer.  In  Section  4  we  show 
experimental  reconstructions  obtained  from  an  im¬ 
plementation  of  the  rotational  shear  interferometer. 

2.  Fourier  Inversion  of  the  Generalized  Van 
Cittert-Zemike  Theorem 

The  mutual  intensity  for  a  quasi-monochromatic  3D 
incoherent  primary  source  can  be  expressed  in  terms 
of  the  source  radiant  power  density  by  use  of  the 
Hopkins  integral: 

exp[/^o(|ri  -  r,|  -  [rg  -  r,|)]  ^3 

1^1  ^s||^2  ^s\ 

where  a  is  the  source  volume,  /(r^)  is  the  3D  source 
radiant  power  density,  J(ri,  r2)  is  the  mutual  inten¬ 
sity  at  field  sample  positions  and  r2,  and  = 
2'n/kQ  is  the  wave  number  of  the  optical  field  at  wave¬ 
length  XqM  The  geometry  of  the  radiation  and  mea¬ 
surement  space  is  illustrated  in  Fig.  1.  is  the 
position  vector  in  the  source  volume.  e/(ri,  r2)  is 
measured  between  pairs  of  points  drawn  from  an 
aperture  labeled  the  correlation  plane.  The  correla¬ 
tion  plane  lies  a  distance  R  along  the  z  axis  from  the 
center  of  the  correlation  volume.  As  is  shown  in  the 
figure,  Tj  and  r2  are  vectors  from  the  origin  of  the 
source  volume  to  field  sampling  points  on  the  corre¬ 
lation  plane.  Jir^y  r2)  is  the  zero-delay  mutual  co¬ 
herence  function  between  the  field  at  and  that  at 
r2.  Systems  for  measuring  Jir^,  rg)  are  described  in 
section  3. 

The  goal  of  coherence  imaging  is  to  invert  Eq.  (1) 
and  reconstruct  /(rj  from  measurements  of  r2). 


Inversion  was  previously  shown  to  be  straightfor¬ 
ward  in  the  Fraunhofer  zone,  where  Eq.  (1)  reduces  to 
the  generalized  van  Cittert-Zemike  theorem 


JirA,  r^2)  =  I\ 


(^1  -  ^2) 
^0 


exp[>^o(ri  -  rz)] 


(2) 


where  Si  and  S2  are  unit  vectors  in  the  and  r2 
directions,  =  \ri\,  r2  =  |r2|,  and  /(u)  is  the  3D 
Fourier  transform  of  the  source  intensity  distribu- 
tion.^’®  u  is  the  position  vector  of /(r^)  in  3D  Fourier 
space.  According  to  Eq.  (2),  measurement  of  J{ri, 
r2)  over  a  range  in  ri  =  r^Si  and  r2  =  r2S2  yields 
samples  of  /(u)  for  u  over  the  range  (sj  -  S2)/^o* 
Inasmuch  as  variations  in  and  r2  do  not  affect  the 
range  sampled  in  u,  it  is  sufficient  to  measure  J(ri, 
r2)  for  and  r2  drawn  from  a  surface  surrounding 
the  object  rather  than  a  volume.  Doing  so  reduces 
the  six-dimensional  measurement  space  of  J(ri,  r2)  to 
four  dimensions.  Even  for  and  rg  drawn  from  a 
surface,  redundant  values  of  (sj  —  S2)/^o  will  be  ob¬ 
tained.  To  characterize  /(rg)  to  wavelength-limited 
resolution  it  is  necessary  only  to  sample  Jir^,  Tg)  over 
a  3D  subspace  of  0  r2  that  fully  samples  the  range 
of  Sj  -^S2-  If  r2)  is  measured  over  this  sub¬ 
space,  /(u)  is  known  for  all  u  such  that  |u|  2/Xo. 

The  sphere  |u|  2/\o  is  the  band  volume  for  this 

imaging  system.  The  band  volume  is  the  3D  spatial 
bandpass  of  the  imaging  system.  The  impulse  re¬ 
sponse  of  the  system  is  the  inverse  Fourier  transform 
of  the  band  volume.  For  the  fully  sampled  imaging 
system,  the  impulse  response  will  be  spherically  s3Tn- 
metric,  with  a  resolution  of  approximately  ko/2. 

In  most  optical  imaging  situations,  particularly  the 
far-field  systems  to  which  Eq.  (2)  applies,  the  source 
volume  is  remote  from  the  correlation  space.  In 
such  cases  it  is  not  possible  to  measure  J(ri,  r2)  over 
a  surface  that  encloses  the  source.  Rather,  the  goal 
for  these  systems  is  to  reconstruct  I{r^)  from  mea¬ 
surements  of  J(ri,  r2)  over  a  limited  range  of  §1  and 
S2.  The  limited  range  is  illustrated  in  Fig.  1  by  the 
circular  aperture  in  the  correlation  plane.  The  effect 
of  limiting  the  range  of  Sj  and  §2  is  to  limit  further  the 
range  of  u  and  thereby  to  reduce  the  band  volume  and 
the  imaging  resolution. 

Rosen  and  Yariv  previously  considered  source  re¬ 
construction  from  a  finite  aperture  in  the  far  field.^-^^ 
The  result  of  Rosen  and  Yariv  is  obtained  by  expan¬ 
sion  of  Si  and  S2  in  terms  of  the  planar  coordinates  of 
the  correlation  plane  as,  for  example, 


^1 ' 


2i?"  I 


(3) 


where  R  is  the  distance  from  the  origin  of  the  source 
volume  to  the  sampling  plane.  The  range  over 
which  /(u)  is  determined  from  measurements  of 
J{Rsi,  RS2)  in  this  plane  is 


u  = 


{Sj  -  S2) 
^0 


Ax  ^  ^  Ay  ^  xAx  +  yAy  ^ 


(4) 
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Fig.  2.  Coordinate  geometry  in  the  sampling  plane.  Source  in¬ 
version  is  simplified  by  use  of  the  transformed  coordinates  (Ax,  Ay) 

=  (^1  -  ^2.  yi  -  y)  =  [(^i  +  %)/2,  iyi  +  >'2)/2],  q  =  ^xx-¥ 
Ayy. 


wherex  =  {x^  +  x<^l2,y  =  {y^  +  ^2)72,  Ax  =  (xj  -  X2), 
and  Ay  =  (y^  yg).  These  correlation  plane  vari¬ 
ables  are  illustrated  in  Fig.  2.  Many  different  com¬ 
binations  of  X,  Ax,  y ,  and  Ay  may  result  in  the  same 
coordinate  in  u.  To  recover  all  the  nonredundant 
information  about  7(u)  available  for  a  given  range  in 
(x,  y,  Ax,  Ay)  one  need  only  measure  the  mutual 
intensity  over  a  3D  projection  of  the  four-dimensional 
X,  Ax,  y,  and  Ay  space.  The  3D  projection  should 
sample  all  allowed  values  of  Ax,  Ay,  and  xAx  +  yAy. 
As  in  Refs.  9-11,  we  define  a  variable  q  =  xAx  +  yAy. 
We  then  define  the  new  function  J3d(Ax,  Ay,  q)^  which 
is  J(ri,  Tg)  restricted  to  the  Ax,  Ay,  q  subspace.  In 
this  subspace,  Eq.  (2)  becomes 


J3d(Ax,  Ay,  q)  = 


1  ;/ 

r"  \oi? 


(5) 


JgoCAx,  Ay,  q)  is  sampled  from  two-point  correlations 
over  the  correlation  plane  of  Fig.  1.  The  source  dis¬ 
tribution  is  recovered  from  these  measurements  by 
inverse  Fourier  transformation  of  Eq.  (5),  which 
yields 


/(r.)*Pp(r,)  =  XR= 


J3d(Ax,  Ay,  q) 


(j2-nx,Ax  ,  j2'ny,Ay 


XqT? 


\qR 

2  |dAxdAydq, 


(6) 


where  p  is  the  range  over  which  the  mutual  intensity 
is  measured  in  (Ax,  Ay,  q)  space  and  is  an 

impulse  response  for  the  coherence  imaging  system. 
PJ(r^  is  the  inverse  Fourier  transform  of  the  band 
volume.  The  band  volume  in  this  case  is  propor¬ 
tional  to  the  sample  range  in  (Ax,  Ay,  q).  The  anal¬ 


ysis  leading  to  Eq.  (5)  follows  discussions  in  previous 
publications,  especially  as  presented  in  Ref.  11. 

To  derive  the  Fresnel-zone  Fourier  relationship  we 
begin  again  with  Eq.  (1).  Both  the  Fresnel-  and  the 
far-zone  approximations  rely  on  paraxial  approxima¬ 
tions  of  |ri  -  r^l  and  |r2  •“  r^l-  The  far-field  approx¬ 
imation  of  relation  (3),  however,  includes  an 
assumption  that  1/i?  is  an  accurate  approximation  of 
l/(i?  -  for  all  points  in  the  source  volume  at  {x^^y^, 
z^).  This  assumption  severely  restricts  the  trans¬ 
verse  extent  of  the  source,  as  discussed  below. 
Rather  than  make  this  assumption,  we  substitute 
l/(i?  -  z^)  for  1/JR  in  the  paraxial  approximation. 
The  resultant  equations  are  substantially  simpler  if 
we  shift  the  origin  of  the  z  axis  to  the  correlation 
plane.  To  do  this,  we  define  a  new  variable,  Zgp  = 
R  -  Zg.  The  correlation  plane  then  corresponds  to 
the  Zgp  =  0  plane,  and  the  paraxial  approximation  is 


^sp 


jxi-xf  ^  {yi-ysf 

22^sp  2Zsp 


+ . 


..  (7) 


Substituting  expression  (7)  into  Eq.  (1)  yields 


rg)  ^ 


/(rj 


sp  , 

2  ^  expl 


X^z, 


sp 


j2TT 
L  XoZgp 


(XgAx+y,Ay) 


j2Tr 

Xo^^sp 


(xAx  +  yAy) 


d^r. 


(8) 


where  Fgp  is  the  position  vector  in  the  source  coordi¬ 
nates  (Xg,  y^,  Zgp)  and,  as  above.  Ax  and  Ay  are  the 
separations  between  the  sampling  points  and  x  and  y 
are  the  mean  positions  of  the  sampling  points  on  the 
correlation  plane.  We  can  obtain  Eq.  (5)  from  Eq.  (8) 
if  we  assume  that  l/Zgp  (l/i?)[l  -  (zJR)],  such 
that  (ZgXgAx)/(Xi?^),  (ZgygAy)/(Xi2^)  <§c  1,  and  that  the 
range  of  (x^,  y^)  is  much  less  than  the  range  of  (x,  y). 
These  approximations  would  mean  that  the  longitu¬ 
dinal  extent  of  the  source  must  be  much  less  than  the 
mean  source  range  and  that  the  transverse  extent  of 
the  source  must  be  much  less  than  the  mean  inter¬ 
ferometer  displacement.  These  are  relatively  harsh 
limitations,  particularly  in  view  of  the  quadratic  de¬ 
crease  in  range  resolution  with  increasing  range. 

We  can  express  Eq.  (8)  as  a  Fourier  transform  with¬ 
out  making  these  approximations  if  we  transform  the 
source  coordinates  into  the  projective  coordinates^® 


^sp  ^sp  ^sp 


Figure  3  illustrates  the  transformation  between  the 
source  coordinates  (x^,  y^,  z^J  and  the  (x',  y\  z') 
coordinate  system,  x'  and  y^are  equal  to  the  tan¬ 
gents  of  the  angles  0^  and  0^  between  the  ray  from  the 
correlation  plane’s  origin  to  the  source  point  (x^,  y^, 
Zgp)  and  to  the  planes  y^  -  0  and  x^  =  0,  respectively. 
In  the  small-angle  approximation,  x'  =  0^  andy'  =  0  . 
Figure  3  is  drawn  in  Cartesian  space  and  shows  grids 
of  constant  x',  y'  in  the  projective  space.  As  indi¬ 
cated  by  the  distortion  between  the  grids,  uniform 
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In  the  primed  coordinates  Eq.  (8)  becomes 


Fig.  3.  Relationship  between  the  Cartesian  source  coordinates 
and  the  projective  coordinates.  The  origin  of  longitudinal  coordi¬ 
nate  2sp  is  in  the  correlation  plane.  Longitudinal  projective  coor¬ 
dinate  z'  =  l/^gp  has  an  origin  at  e^p  =  oc  and  is  equal  to  1/R  at  the 
center  of  the  source  volume.  In  the  small-angle  approximation, 
the  transverse  projective  coordinates  x'  ==  and  y'  =  z'y^  cor¬ 
respond  to  the  Eingles  6^  and  0^  between  the  y  =  0  and  jc  =  0  planes 
and  the  ray  from  the  correlation  plane  origin  to  the  real-space 
source  point. 


sampling  in  the  primed  coordinate  system  yields  non- 
uniform  samples  in  Cartesian  space.  The  orienta¬ 
tion  of  the  primed  axes  is  shown  at  the  lower  left  of 
Fig.  3.  The  origin  of  the  axis  is  at  ^  off  the 

left  of  the  figure.  The  correlation  plane,  which  is 
assumed  not  to  lie  in  the  source  volume,  is  at  z'  —  oc. 
One  can  translate  displacements  in  the  {x\  y\  z') 
coordinate  system  into  real  space  displacements  by 
using  the  differential  relationships 


JsoiAx,  Ay,  q)  = 


X  exp 


-j2TT 

^0 


ix'Ax  +y'Aj) 


+ 


j2ir 

^0 


d^i 


(12) 


where  a'  is  the  source  volume  expressed  in  the  trans¬ 
formed  coordinates.  As  in  the  far-field  case,  q  = 
xAx  +  yAy  and  Jg^CAx,  Ay,  q)  is  J(ri,  r2)  in  the  3D 
subspace.  Note  that  the  Jacobian  factor  for  the  dif¬ 
ferential  combines  with  the  denominator  of 

source  radiation  factor  (z^)  to  maintain  the  form  of 
the  1/z'^  radiation  factor.  Equation  (12)  can  be  ex¬ 
pressed  in  analogy  with  Eq.  (5)  as 


1  -  /A:x:  Ay  q\ 

J3d(Ax,  Ay ,  q)  =  -2  7,  — ,  / ,  f  ,  (13) 

^  \  ^0  ^0  ^0/ 

where  7p(u)  is  the  3D  Fourier  transform  with  respect 
to  {x\  y',  z')  of  I{x',  y',  Since  care  must  be 

taken  to  avoid  the  singularity  at  z'  =  0,  the  Fourier 
transform  of  I{x\  y',  z')lz''^  cannot  be  taken  over 
unbounded  space.  The  range  of  integration  is 
boimded  by  the  assumption  that  the  source  distribu¬ 
tion  has  finite  support  and  that  the  correlation  plane 
is  far  removed  from  the  source.  As  in  the  far-field 
case,  one  recovers  the  incoherent  intensity  distribu¬ 
tion  of  the  distributed  source  by  inverse  Fourier 
transforming  Eq.  (13),  using  the  mutual  intensity 
sampled  in  the  correlation  plane  in  pairs  of  coordi¬ 
nates  parameterized  in  (Ax,  Ay,  q).  In  analogy  with 
Eq.  (6),  this  approach  yields 


dx  = 


z'dx'  -  x'dz' 

^r2 


dy  = 


2'dy'  —  y'dz' 


dz  =  - 


(10) 


Neglecting  the  dz'  dependence  of  the  x  and  y  resolu¬ 
tions  and  substituting  2:  =  Ijz'  simplify  these  rela¬ 
tionships  to 


dx  =  2:dx',  dy=2dy',  d2=2:^d2:'.  (11) 


These  relationships  quantify  the  distorted  Cartesian 
space  grid  sampling  shown  in  Fig.  3.  For  example, 
uniform  steps  in  dz'  yield  grid  spaces  that  increase  as 
z^  in  real  space.  The  sampling  resolution  decreases 
in  both  the  transverse  and  the  longitudinal  directions 
as  the  distance  from  the  image  plane  increases,  but 
the  angular  grid  spacings  dx/z  and  dy/z  remain  con¬ 
stant. 


Iix\y\z') 


*  Pp(r')  ==  \  J3d(Ax,  Ay,  q) 


j2'n 

(x'Ax  +y'Ay) 

^0 


X  exp 


- z  q 

Xo 


dAxdAydq.  (14) 


The  source  intensity  in  the  Cartesian-space  coordi¬ 
nate  system  is  determined  by  transformation  of  I{r') 
to  the  Fg  coordinate  system.  As  in  the  far-zone  case, 
^(rO  is  the  Fourier  transform  of  the  band  volume. 
The  primary  difference  between  Eqs.  (5)  and  (6)  and 
Eqs.  (13)  and  (14)  is  that  the  ratio  of  the  source  extent 
to  the  source  range  can  be  larger  in  the  latter.  This 
means  that  Eqs.  (13)  and  (14)  can  accurately  recon¬ 
struct  a  source  of  a  given  size  from  a  closer  range  than 
can  Eqs.  (5)  and  (6).  Because  the  band  volume  in 
both  cases  scales  with  the  ratio  of  lateral  aperture  to 
the  source  range,  a  closer  range  means  a  bigger  band 
volume  and  better  resolution. 
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3.  Measurement  Systems,  Band  Volume,  and  impulse 
Response 

In  Section  2  we  derived  source-reconstruction  algo¬ 
rithms  from  limited-aperture  coherence  measure¬ 
ments.  In  this  section  we  consider  two  particular 
physical  systems  for  obtaining  these  coherence 
measurements  and  we  analyze  the  band  volume 
and  the  impulse  response  for  each  system.  The 
two  systems  that  we  consider  are  the  Michelson 
stellar  interferometer  (MSI)  and  the  rotational 
shear  interferometer  (RSI).  The  MSI,  first  imple¬ 
mented  in  1878,^®  is  the  protot3rpical  astrometry 
instrument  and  was  used  by  Rosen  and  Yariv  to 
demonstrate  3D  coherence  imaging.  MSI  has  gen¬ 
eral  utility  as  an  interferometer,  but  because  it  col¬ 
lects  only  one  correlation  for  each  instrument 
position  it  is  extraordinarily  inefficient  as  an  imag¬ 
ing  instrument.  The  RSI  has  a  much  briefer  his¬ 
tory  but  still  has  been  under  investigation  for  more 
than  three  decades. Roddier^  and  Roddier  and 
Rodier^®  have  used  the  RSI  for  2D  imaging,  and  Itoh 
et  used  RSI  data  to  reconstruct  3D  data  sets 

consisting  of  two  spatial  dimensions  and  one  spec¬ 
tral  dimension.  The  advantage  of  the  RSI  is  that  it 
samples  entire  planes  of  independent  coherence 
measurements  in  parallel.  In  this  section  we 
briefly  review  data  acquisition  with  the  MSI  and 
RSI,  and  we  analyze  the  band  volume  and  the  im¬ 
pulse  response  for  typical  implementations  of  each 
instrument. 

The  MSI  consists  of  two  field-sampling  ports 
mounted  upon  a  single  mechanical  beam.  One  com¬ 
bines  the  field  drawn  from  the  sampling  ports 
through  an  optical  system  to  determine  the  mutual 
intensity  between  the  two  sampling  points.  Various 
mechanisms  can  be  employed  to  adjust  the  relative 
path  lengths  fi-om  the  sampling  ports  to  the  detector 
that  determines  the  mutual  intensity.  The  phase 
and  the  amplitude  of  the  mutual  intensity  can  be 
extracted  from  a  spatial  fringe  pattern  or  by  dither¬ 
ing  of  the  relative  delay  of  the  optical  paths.  We  do 
not  consider  the  beam-combining  optics  here.  It  is 
useful,  however,  to  consider  the  sample  point  geom¬ 
etry  in  the  correlation  plane,  which  is  illustrated  in 
Fig.  4.  The  sample  points  lie  upon  the  mechanical 
beam  that  passes  through  the  origin  of  the  correla¬ 
tion  plane.  The  beam  rotates  freely  about  the  origin 
but  cannot  be  displaced.  The  sample  points  may  lie 
anywhere  along  the  beam.  We  define  the  new  vari¬ 
able  to  be  the  maximum  distance  of  a  sampling 
point  from  the  origin,  is  also  the  radius  of  the 
correlation  plane  aperture  and  half  of  the  length  of 
the  MSI  beam. 

We  define  three  new  variables  to  describe  the  state 
of  the  MSI.  ([)  is  the  angle  between  the  mechanical 
beam  and  the  x  axis.  The  range  of  4)  is  [0,  2Tr].  d  is 
the  separation  between  the  sampling  points.  The 
range  of  d  is  [0,  2r^^],  d  is  the  distance  of  the 
midpoint  between  the  sampling  ports  from  the  origin. 
The  range  of  ^  is  [(d/2)  -  -  (d/2)].  The 


Fig.  4.  Geometry  of  the  MSI  correlation  plane:  radius  of 

the  system  aperture;  d,  sampling-point  separation;  3,  distance 
between  the  midpoint  of  the  sampling  points  and  the  origin;  <|), 
angle  between  the  interferometer  beam  and  the  x  axis. 

sample  space  coordinates  for  a  given  interferometer 
state  are 

Ajc  =  d  cos(|), 

Ay  =  d  sin(|), 

q  =  M.  (15) 

Using  the  ranges  described  above,  we  find  that  Ax 
and  Ay  cover  the  range  [-2r^g^^,  The  range 

of  q  varies  as  a  function  of  Ax  and  Ay.  For  a  given 
value  of  d  =  VAx^  +  Ay^,  the  range  of  q  is  {-d[ri„ax 
-  (d/2)],  d[r^^  -  (d/2)].  The  band  volume  is  the 
range  of  u  over  which  /(u)  or  /^(u)  can  be  sampled. 
The  band  volume  is  the  Fourier  transform  of  the 
impulse  response  Ppir^),  which  is  used  in  Eqs.  (6)  and 
(14).  In  the  far-field  reconstruction  of  Eq.  (5),  we 
find  that  u  =  [(Ax/Xq-R),  (Ay/Xqi?),  (g/XoR^)].  For 
the  projective  coordinates  used  in  the  Fresnel  case, 
we  find  from  Eq,  (13)  that  u  =  [(Ax/Xq),  (Ay/Xo), 
(q^/^o)]*  both  cases  the  band  volume  is  propor¬ 
tional  to  the  range  of  (Ax,  Ay,  q). 

The  band  volume  for  the  MSI  is  sketched  in  Fig.  5. 
The  axes  in  the  figure  are  scaled  in  terms  of 
where  R  is  the  nominal  distance  from  the  source  to 
the  correlation  plane.  Because  r^^/R  <  1  in  both 
the  Fraunhofer  and  the  Fresnel  domains  and  because 
scales  as  r^^/R^,  the  axis  is  greatly  expanded 
relative  to  the  and  Uy  axes  in  the  figure.  The  band 
volume  is  useful  in  estimating  the  resolution  of 
source  reconstruction  and  in  designing  the  coherence 
sampling  scheme.  The  resolution  along  any  given 
direction  can  be  approximated  by  the  inverse  of  the 
extent  of  the  band  volume  along  that  direction.  This 
approximation  yields  transverse  resolution  XoR/r^^x 
and  longitudinal  resolution  XoR^/r^max  l^be  Fraun¬ 
hofer  zone.  In  the  primed  Fresnel-zone  coordinates, 
the  transverse  resolution  is  Xo/rj„ax  the  longitu¬ 
dinal  resolution  is  Xo/r^ax^-  Note  that  the  trans¬ 
verse  and  the  longitudinal  coordinates  are  not  in  the 
same  imits.  When  the  conversion  factors  from  dis¬ 
torted  to  Cartesian  space  listed  in  Eq.  (9)  are  applied, 
the  Fresnel-zone  resolution  is  also  XoR/rj^^  in  trans- 
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Fig.  5.  Band  volume  for  MSI  sampling.  The  band  volume  is 
plotted  in  the  real-space  Fourier  space  of  the  source  density  for 
the  Fraunhofer  zone  and  in  the  projective-space  Fourier  space 
for  the  Fresnel  zone.  The  coordinate  axes  correspond  to  the  Fou¬ 
rier  coordinates  The  transverse  coordinates  are  nor¬ 

malized  with  respect  to  r„ax/^o^-  Th^  longitudinal  coordinate  is 
normalized  with  respect  to  r^^^/kQR^.  Because  r^^/R  <3C  1,  the 
normalization  frequency  for  the  longitudinal  axis  is  less  than  it  is 
for  the  transverse  axes.  The  missing  cone  in  the  Fourier  space 
along  the  axis  is  characteristic  of  limited-angle  tomographic 
systems. 

verse  coordinates  and  Xoi?^/rj„ax^  longitudinally. 
These  estimates  are  confirmed  in  models  of  the  im¬ 
pulse  response  presented  below. 

The  contraction  of  the  band  volume  along  the  lon¬ 
gitudinal  axis  near  the  origin  (the  "missing  cone”i^) 
acts  as  a  high-pass  filter  on  the  reconstructed  source 
distribution.  This  filtering  has  two  effects:  First, 
objects  with  high-fi^equency  transverse  spatial  fea¬ 
tures  will  be  better  resolved  longitudinally  than  more 
nearly  uniform  objects  and,  second,  interference  sam¬ 
pled  between  distant  points  covers  more  of  the  band 
volume  and  thus  contains  more  information  than  in¬ 
terference  between  near  neighbors.  The  first  effect 
means  that  one  could  not  resolve  a  longitudinally 
distributed  set  of  viniform  planar  sources  at  all  but 
that  one  could  easily  resolve  discrete  point  sources. 
The  Fourier-space  representation  of  the  planar 
sources  is  a  set  of  points  on  the  axis,  exactly  or¬ 
thogonal  to  the  band  volume.  The  Fourier  represen¬ 
tation  of  the  point  sources  covers  the  u^-Uy  plane, 
fully  overlapping  the  band  volume.  In  view  of  the 
second  point  one  may  seek  to  measure  correlation 
samples  with  separations  that  match  the  direction  of 
the  lobes  of  the  band  volume  so  that  high-frequency 
details  that  provide  depth  information  are  not 
missed. 

As  was  mentioned  above,  the  MSI  samples  only  one 
correlation  per  instrument  position.  Other  designs 
based  on  RSTs  are  attractive  because  they  sample 
complete  planes  in  {Ax,  Ay)  space  in  parallel.  The 
primary  components  of  the  RSI,  as  illustrated  in  Fig. 
6,  are  a  beam  splitter  and  two  folding  mirrors.  The 
field  incident  upon  the  folding  mirrors  is  reflected 
back  through  the  output  port  of  the  beam  splitter  and 
detected  at  every  point  in  the  output  plane.  The 
folding  mirrors  consist  of  two  planar  reflectors  joined 
at  right  angles.  The  folding  mirrors  are  often  imple¬ 
mented  by  the  use  of  roof  prisms.  Each  folding  mir¬ 
ror  inverts  the  reflected  field  about  its  fold  axis.  The 


Fig.  6.  Basic  structure  of  a  rotational  shear  interferometer.  The 
RSI  is  a  Michelson  interferometer  in  which  the  plane  retroreflec- 
tion  mirrors  have  been  replaced  with  folding  mirrors.  The  folding 
axes  of  the  mirrors  lie  in  the  transverse  plane  at  angles  (|>  and  -<j> 
with  respect  to  the  x  axis.  The  output  port  interferes  differen¬ 
tially  rotated  wave  fronts  from  the  two  mirrors. 

fold  axes  of  both  mirrors  lie  in  the  transverse  plane. 
As  shown  in  Fig.  6,  the  fold  axis  of  one  mirror  makes 
an  angle  0  with  respect  to  the  x  axis.  The  fold  axis  of 
the  other  mirror  makes  an  angle  -0  with  respect  to 
the  X  axis.  Let  the  transverse  coordinates  in  the 
output  planes  of  the  RSI  be  {Xf,  yA  The  field  pro¬ 
duced  at  the  output  point  {x^,  y^)  by  the  fold  mirror 
with  an  axis  at  angle  0  relative  to  the  x  axis  is  the  field 
that  would  appear  at  {XfCos  20  -  yf  sin  20,  -  XfSin  20 
-  y^  cos  20)  if  the  fold  mirror  were  replaced  with  a 
plane  mirror.  If,  for  example,  0  =  0,  the  fold  mirror 
would  reflect  across  the  x  axis  and  the  output  point 
{x^,  y^)  would  correspond  to  the  plane-mirror  output 
point  (xf,  -yf).  The  field  produced  at  {Xf,  yf)  by  the 
*“0  mirror  would  appear  at  {XfCos  20  +  y^sin  20,  x^sin 
20  -  yf  cos  20)  if  that  mirror  were  replaced  with  a 
plane  mirror.  The  mutual  coherence  between  fields 
that  is  due  to  the  two  mirrors  can  be  determined  by 
longitudinal  dithering  of  one  of  the  fold  mirrors. 
Each  point  in  the  output  window  samples  the  mutual 
coherence  for  a  distinct  transverse  separation  rela¬ 
tive  to  the  plane-mirror  Michelson  interferometer. 
The  separations  and  mean  positions  for  the  mutual 
coherence  sampled  at  {xf,  yf)  are 

^x(xf,yf)  =  2y/-sin(20), 

^y(Xf,  yf)  =  2xf  sm(2e) ,  ( 16) 

^{Xf,  yf,  Xg)  =  2xf  cos(20)  +  Xg, 

yixf,  yf,  yg)  =  -  2yf  cos(20)  +  yg,  ( 17) 

where  {Xg,yg)  is  the  transverse  displacement  between 
the  origins  of  the  output  plane  coordinates  and  the 
source  volume  coordinates.  The  q  coordinate  at  each 
point  in  the  output  plane  is 

q  =  Axixf,  yf)x{xf,  yf,  Xg)  +  Ay{xf,  yf)y{xf,  yf,  Xg) 

=  iyfXg  -  3C/^yg)sin(20).  (18) 

A  RSI  samples  a  surface  in  (Ax,  Ay,  q)  space  for  each 
value  for  (x^,  y^.  To  sample  the  entire  accessible  3D 
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Fig.  7.  Band  volume  for  linear  translation  RSI  sampling.  The 
situation  is  identical  to  that  of  Fig.  4,  except  that  the  normalization 
of  the  axis  is  now  is  the  linear  displace¬ 

ment  range  for  the  RSI.  For  the  RSI  of  this  figure,  ^  =  -77/4  and 
the  fold  axes  of  the  two  mirrors  are  perpendicular.  In  this  geom¬ 
etry,  the  RSI  is  also  called  a  wave-front  folding  interferometer. 


(Ajc,  Ay,  q)  space  one  translates  the  interferometer  in 

(xg,  yg). 

As  for  the  MSI,  let  be  the  radius  of  the  RSI 
aperture.  Let  Xg  ^  be  the  distance  over  which  the 
RSI  is  translate<fl;ransversely  to  the  optical  axis. 
The  band  volume  captured  by  a  RSI  with  0  =  7r/4 
translated  linearly  along  the  Xg  axis  is  shown  in  Fig. 
7.  0  =  77/4  corresponds  to  a  special  class  of  RSI,  the 
wave-front  folding  interferometer.^s  The  crease  in 
the  band  volume  of  Fig.  7  along  the  Uy  axis  is  due  to 
the  fact  that  q  vanishes  normally  to  the  translation 
direction  for  linear  translation  of  the  RSI  so  that  only 
object  features  and  edges  perpendicular  to  the  path 
contribute  to  longitudinal  resolution.  This  crease 
can  be  avoided  by  translation  of  the  RSI  along  a 
nonlinear  path.  For  example.  Fig.  8  shows  the  band 
volume  when  RSI  with  circular  aperture  r^iax  is 
translated  in  a  circle  of  radius  Xg^^.  Reducing  0  de¬ 
creases  the  effective  aperture^'^^of  the  RSI  and 
thereby  decreases  its  resolution.  This  may  be  desir¬ 
able,  particularly  if  one  wishes  to  match  interference 
fringes  in  the  output  plane  to  a  CCD  pixel  spacing. 

We  now  consider  impulse  responses  for  MSI  and 
RSI  systems.  As  a  benchmark  of  the  resolution  of 
these  systems,  we  calculate  impulse  response  under 


Fig.  8.  Band  volume  for  imaging  with  a  circularly  translated  RSI. 
The  situation  is  identical  to  that  of  Fig.  6,  except  that  Xg^^^^  now 
represents  the  radius  of  the  circle  about  which  the  optical  axis  of 
the  RSI  is  translated. 


Longitudinal  Coordinate  (rrr*)  Lateral  Coordinate  (rad) 

Fig.  9.  Surface  plot  of  the  3D  MSI  impulse  response  in  the  x'-z' 
plane.  The  vertical  axis  is  normalized  to  the  maximum  response. 
The  spatial  axes  are  in  projective  coordinates,  with  units  of  inverse 
meters  for  the  longitudinal  axis  and  radians  for  the  transverse 
axis.  The  impulse  response  is  approximately  shift  invariant  in 
the  projective  space;  it  is  not  shift  invariant  in  real  space.  To 
obtain  the  real-space  impulse  response  one  adds  1/i?  to  the  longi¬ 
tudinal  range  and  takes  the  inverse.  For  an  impulse  at  1  m,  a 
point  at  z'  =  0.1  is  at  z  =  1/(1  +  0.1)  =  0.91.  A  point  at  z'  =  -0.1 
isatz  =  1/(1  -  0.1)  =  1.11. 


the  assumption  that  the  correlation  plane  aperture  is 
fixed  in  space.  This  assumption  is  not  likely  to  re¬ 
flect  practical  RSI  uses  in  which  the  aperture  moves 
with  the  instrument,  but  a  fixed  aperture  gives  us  a 
common  basis  for  comparing  the  two  interferometers. 
To  find  the  impulse  response  for  the  fixed  aperture  we 
set  correlations  between  pairs  of  points  where  either 
pair  of  correlated  points  (x^,  y-^)  or  ix2, 3^2)  was  outside 
the  aperture  {x/  +  >  r„a/)  or  ix2^  +  y^)  > 

^max^)  to  zero. 

We  model  the  impulse  response  of  a  Fresnel-zone 
imaging  system  by  calculating  the  mutual  intensity 
as  a  function  of  space,  using  Eq.  (13),  and  then  in¬ 
verting  the  mutual  intensity  to  find  the  filtered 
source  intensity,  using  Eq.  (14),  under  aperture  and 
sampling  constraints  of  the  imaging  system.  Our 
simulations  use  a  discrete  64  X  64  X  64  point-source 
volume,  consisting  of  one  nonzero  intensity  point, 
that  was  propagated  by  means  of  a  fast  Fourier  trans¬ 
form  to  provide  the  mutual  intensity  correlations  as  a 
function  of  Ax,  Ay,  and  q.  We  then  inverse  by  fast 
Fourier  transform  the  mutual  intensity  to  recon¬ 
struct  the  filtered  source  intensity.  Because  the  in¬ 
put  is  a  single  point,  this  reconstruction  is  the 
impulse  response.  In  general,  each  (Ax,  Ay,  q)  cor¬ 
responds  to  multiple  pairs  of  correlation  plane  points 
(^i5  yi)  OJ*  3'2)-  MSI  and  RSI  approaches,  as 
well  as  other  potential  sampling  schemes,  improve 
sampling  efficiency  by  associating  each  (Ax,  Ay,  q) 
with  unique  values  of  (xj,  y^)  and  (xg,  y2)* 

Figure  9  is  a  surface  plot  of  a  cross  section  of  the 
impulse  response  for  MSI  sampling  for  a  0.5-cm  ap¬ 
erture  and  a  wavelength  of  632.8  nm.  The  lateral 
coordinate  is  in  angular  units  and  the  longitudinal 
coordinate  is  in  units  of  inverse  distance,  consistent 
with  the  primed  coordinate  system.  To  transform 
these  units  into  real  space,  one  multiplies  the  trans¬ 
verse  coordinate  by  the  source- correlation  plane  dis- 
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Fig.  10.  Cross  section  of  the  RSI  impulse  response  in  the  x'-z' 
plane  under  the  same  constraints  as  for  Fig.  9. 


tance  and  the  longitudinal  coordinate  by  the  square 
of  this  distance.  At  2  m,  for  example,  the  center  spot 
size  is  approximately  0.025  cm  along  the  transverse 
axis  and  14  cm  along  the  longitudinal  axis.  Figure 
10  is  the  cross  section  of  the  RSI  impulse  response. 
The  values  of  all  sampling  parameters  were  identical 
for  both  simulations. 

To  compare  the  resolution  of  the  two  sampling 
schemes  we  use  relations  between  lateral  and  longi¬ 
tudinal  resolution  and  aperture  size: 


(19) 


where  is  the  lateral  resolution  size  in  radians,  2:^68 
is  the  longitudinal  resolution  size  in  inverse  length,  d 
is  the  aperture  diameter,  and  and  are  sampling- 
scheme-dependent  unitless  constants,  where  a 
smaller  number  indicates  a  smaller  resolution  ele¬ 
ment  size  or  better  resolution.  The  resolution  here 
is  not  calculated  with  the  Rayleigh  two-point  crite¬ 
rion;  rather,  it  uses  the  root-mean-square  size  of  the 
point-spread  function  (PSF).  For  the  MSI,  =  0.95 
and  =  1.38,  whereas  for  the  RSI,  =  1.15  and 
=  1.65. 

Under  the  definition  of  aperture  used  here,  there  is 
little  difference  in  resolution  between  the  RSI  and  the 
MSI  sampling  schemes.  Each  of  the  sampling 
schemes  has  its  own  advantages  and  disadvantages, 
however.  The  MSI  scheme  most  effectively  utilizes 
a  circular  aperture  of  a  given  size  because  the  trans¬ 
lation  (f ,  y)  is  always  in  the  same  direction  as  the 
displacement  (Ax,  Ay),  so  the  value  of  q  is  maximized. 
The  MSI  approach  will  contain  more  correlations 
within  a  fixed  sized  aperture  and  therefore  is  ex¬ 
pected  to  provide  superior  longitudinal  resolution. 
Our  simulations  seem  to  indicate  that  this  difference 
may  not  be  great  because  the  two  methods  yield  sim¬ 
ilar  impulse  responses.  The  advantages  of  the  RSI 
approach  are  that  data  are  taken  in  parallel  and  that 
the  higher  acquisition  speed  makes  teanslation  of  the 
instrument  more  attractive.  Parallel  acquisition 
speeds  acquisition  and  reduces  stabilization  require¬ 
ments.  By  translating  the  instrument  as  a  whole 
one  avoids  the  fixed-aperture  assumption  of  our  sim¬ 
ulations,  to  permit  a  greater  range  for  the  mean 


transverse  displacement  of  sample  points  than  for 
the  maximum  sample  separation.  This  approach 
can  substantially  improve  the  resolution  obtained. 

4.  Experimental  Results 

We  explored  our  PSF  models  experimentally  by  mea¬ 
suring  correlations  produced  by  a  laser  diode  with  a 
RSI.  We  measured  the  correlations  by  translating 
the  RSI  laterally  perpendicular  to  the  RSI  optical 
axis  and  sampling  the  interference  intensity  with 
various  phase  shifts  at  each  lateral  position. 

Our  RSI  consisted  of  a  5.08-cm-aperture  cube  beam 
splitter  with  two  5.08-cm  folding  mirrors,  each  con¬ 
structed  from  two  separate  mirrors  affixed  to  each 
other  at  a  90-deg  angle  (Fig.  11).  Each  of  the  mir¬ 
rors  could  be  independently  rotated  about  its  axis 
such  that  the  shear  angle  and  the  alignment  axis 
could  be  set.  The  focal-plane  array  was  a  Princeton 
Instruments  512  X  512  backilluminated  CCD  camera 
placed  at  the  output  face  of  the  RSI.  To  provide  the 
longitudinal  delay,  one  of  the  folding  mirrors  was 
placed  upon  a  piezo-driven  flexure  stage,  which  per¬ 
mitted  precise  control  of  relative  path  length  down  to 
10-nm  resolution  when  it  was  used  in  conjunction 
with  an  inductive  positioning  sensor.  All  these  op¬ 
tical  components  were  in  suitable  optical  moimts  and 
bolted  to  a  1.9-cm-thick  stainless-steel  plate,  which 
was  itself  bolted  to  a  1.27-cm-thick  steel  plate  to  pro¬ 
vide  the  required  vibration  stability  to  minimize 
noise.  The  bottom  plate  was  placed  upon  two  steel 
rails,  and  the  RSI  was  moved  along  the  rails  by  an 
Aerotech  translation  stage,  which  could  move  the  in¬ 
terferometer  over  a  5-cm  distance.  Even  with  the 
extremely  rigid  steel,  the  plates  collectively  bent 
enpugh  to  change  the  path  length  delay  -^20  fim  over 
its  fiill  range  of  travel,  and  this  misadjustment  was 
repeatable  and  corrected  for  when  the  path-length 
delay  was  set. 

We  measured  the  impulse  response  of  this  system 
by  using  a  laser  diode  that  had  a  center  wavelength  of 
660  nm.  The  diode  facets  were  damaged  to  inhibit 
lasing,  and  the  device  was  used  as  a  LED  with  a 
20-nm  spectral  bandwidth.  The  source  provided  an 
elliptical  radiation  pattern  that  completely  filled  the 
aperture.  An  iris  was  used  as  the  pupil  stop  to  con¬ 
trol  the  aperture  size.  The  RSI  imaged  the  source  at 
256  different  positions  of  the  translation  stage  sepa¬ 
rated  by  34  ixm.  At  each  transverse  RSI  position, 
images  were  recorded  for  eight  different  relative  path 
delays  between  the  folding  mirrors.  These  longitu¬ 
dinal  dithers  were  separated  by  0.125  wavelength, 
centered  about  zero  path  delay.  The  complex  mu¬ 
tual  intensity  across  the  RSI  output  plane  was  iso¬ 
lated  from  these  eight  measurements  in  two  steps. 
First  we  multiplied  the  2D  pattern  recorded  for  each 
delay  by  the  phase  factor  exp(-j4Tr8/Xo),  where  8  is 
the  path  delay.  Then  we  summed  all  eight  modu¬ 
lated  frames.  This  process  isolates  the  component  of 
the  output  intensity  that  oscillates  at  the  frequency 
2/Xo  under  longitudinal  dithering.  This  component 
is  the  mutual  intensity.  The  RSI  detects  the  mutual 
intensity  as  a  function  of  Ax  and  Ay  on  the  Cartesian 
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Fig.  11.  RSI  used  to  measure  the  mutual  coherence  of  the  four-LED  test  object  and  RSI  impulse  response.  The  RSI  consisted  of  (a)  a 
5  cm  X  5  cm  X  5  cm  cube  beam  splitter  with  (b)  two  5  cm  X  5  cm  folding  mirrors.  Each  folding  mirror  was  constructed  from  two  separate 
mirrors  affixed  to  each  other  at  a  90-deg  angle,  giving  a  full  5  cm  X  5  cm  square  aperture.  A  Princeton  Instruments  512  X  512 
backilluminated  CCD  was  used  as  the  focal-plane  array.  For  longitudinal  delay,  one  of  the  folding  mirrors  was  placed  upon  a 
piezoelectric-driven  flexure  stage  in  conjunction  with  an  inductive  positioning  sensor.  The  RSI  was  mounted  upon  two  linear  bearings 
and  was  translated  over  a  5-cm  length  by  an  Aerotech  translation  stage. 


CCD  grid  and  for  uniform  shifts  in  Xg,  We  trans¬ 
formed  these  measurements  into  uniform  estimates 
of  mUsyy  ZxAx)  for  integrals  n,  m,  and  /  by  a 

series  of  one-dimensional  interpolations.  We  used 
the  approximate  prolate-spheroidal  interpolation  se- 
ries24  to  implement  this  transformation.  We  then 
implemented  a  3D  fast  Fourier  transform  of 
mAy,  ZjcAx)  over  the  indices  n,  Z,  and  m  to  obtain  the 
ftmction  I{xlz,ylzy  \lz')lz^. 

The  lateral  aperture  diameter  in  our  PSF  experi¬ 
ment  was  5.6  mm.  The  RSI  was  set  with  a  90-deg 
rotational  shear  angle,  and  the  total  translation  dis¬ 
tance  was  8.7  mm  to  ensure  full  sampling  of  the 
aperture.  The  results  of  the  3D  reconstructed  PSF 
are  shown  in  Fig.  12.  Because  the  simulated  and 


measured  aperture  sizes  were  so  similar,  there  is 
close  agreement  between  the  sizes  of  the  measured 
and  the  simulated  PSF’s.  There  is  a  slight  as3nnme- 
try  in  the  measured  PSF,  because  the  iris  is  not  com¬ 
pletely  coincident  with  the  axis  of  the  RSI  at  the 
center  position  of  the  lateral  travel. 

We  also  used  this  experimental  system  to  recon¬ 
struct  more-complex  sources.  For  example,  we  im¬ 
aged  a  source  consisting  of  four  light-emitting  diodes 
at  Xq  =  640  nm.  In  this  case,  no  aperture  stop  was 
used  to  limit  resolution.  The  mutual  intensity  was 
measured  by  the  RSI  with  its  shear  angle  set  to  19  deg. 
The  RSI  was  translated  laterally  by  a  micrometer- 
resolution  translation  stage  to  256  different  positions 
193  |jLm  apart.  We  obtained  a  2D  measure  of  the 
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Fig.  12.  Experimental  cross  section  of  the  RSI  impulse  response 
in  the  x'-z'  plane.  The  four  comers  of  the  plane  and  the  peak  are 
labeled  with  their  Cartesian  coordinates  in  real  space,  in  meters, 
relative  to  the  origin  of  the  focal-plane  array.  This  impulse  re¬ 
sponse  was  sampled  by  a  linearly  translated  RSI  by  use  of  the 
procedure  and  the  experimental  parameters  described  in  the  text. 


(0037. 


Fig.  13.  Experimental  reconstruction  of  a  four-light-emitting- 
diode  test  source,  as  sampled  by  the  RSI.  The  50%  power  density 
isosurface  is  shown.  The  LED’s  appear  to  be  of  different  sizes 
because  they  were  in  fact  of  different  intensities.  The  source  is 
shown  in  projective  coordinates,  but  the  comers  are  labeled  in 
Cartesian  coordinates,  in  meters,  relative  to  the  origin  of  the  focal- 
plane  array.  These  data  were  taken  by  a  RSI  by  use  of  the  pro¬ 
cedure  and  the  experimental  parameters  described  in  the  text. 


mutual  intensity  at  each  position,  using  the  eight- 
longitudinal-position  approach  described  above  for 
the  PSF  measurement.  Figure  13  shows  the  esti¬ 
mated  power  density  of  the  LED  sources  as  a  50% 
constant  isosurface  of  the  maximum  power  density 
in  the  source.  Because  the  LED's  provide  differing 
intensities,  each  appears  to  be  a  different  size, 
when  they  were  in  fact  all  similarly  sized.  Three  of 
the  LED's  were  in  a  rear  plane  approximately  1.5  m 
from  the  RSI  pupil  plane  and  one  was  1  m  away. 
The  longitudinal  accuracy  of  reconstruction  was  ap¬ 
proximately  0.2  m”^,  or  20  cm  at  a  1-m  distance. 
These  results  demonstrate  that  lensless  imaging  of 
3D  sources  with  coherence  measurements  alone  is 
possible. 

5.  Conclusion 

We  have  shown  that  finite-aperture  3D  coherence 
imaging  can  be  extended  to  the  Fresnel  diffraction 
zone  by  straightforward  Fourier  analysis,  and  we 
have  analyzed  the  resolution  of  both  Fraunhofer-  and 


Fresnel-zone  imaging.  The  PSF  of  a  rotational 
shearing  interferometer  was  also  experimentally 
measured.  Although  coherence  imaging  holds  the 
potential  to  revolutionize  3D  imaging,  several  further 
questions  remain  to  be  addressed.  Most  notably, 
noise  issues  are  not  addressed  here  but  will  play  an 
important  role  in  computational  coherence  imaging. 
It  is  interesting  to  note  that,  in  contrast  with  the 
point-to-point  independence  of  conventional  imaging 
systems,  system  noise  scales  with  object  complexity 
in  coherence  imaging  systems.  When  the  informa¬ 
tion  capacity  of  a  conventional  imaging  system  is 
limited  only  by  the  space-bandwidth  product,  the 
information  capacity  of  a  coherence  imaging  system 
will  be  limited  by  both  the  space-band  volinne  prod¬ 
uct  and  noise  scaling. 
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We  present  a  novel  sensor  that  measures  the  entire  spatial  coherence  function  within  an  aperture  by  use  of 
a  variable  astigmatic  lens.  This  sensor  permits  digital  capture  and  processing  of  partially  coherent  fields. 
We  demonstrate  the  sensor  by  sampling  and  computing  the  coherent  modes  of  a  three-dimensional  incoherent 
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With  digital  sensing  and  processing  becoming  common¬ 
place  in  optical  imaging,  one  wonders  if  a  nonimaging 
sensor  may  allow  a  wider  range  of  information  about 
the  optical  field  to  be  sampled  and  processed.  For 
example,  the  full  set  of  correlations  between  points 
within  a  two-dimensional  aperture  forms  a  four¬ 
dimensional  (4-D)  set  of  potentially  independent  data. 
If  the  entire  coherence  function  in  the  aperture  could 
be  sampled,  a  new  analysis  of  the  data  would  be  avail¬ 
able  that  cannot  be  performed  on  incomplete  data.  In 
this  Letter  we  propose  a  new  type  of  sensor,  the  astig¬ 
matic  coherence  sensor  (ACS),  which  is  able  to  sample 
the  4-D  coherence  function  in  an  aperture.  The  ACS 
addresses  the  stability  and  signal-to-noise  limitations 
associated  with  other  coherence-sensing  instruments 
such  as  the  Michelson  stellar  interferometer  and 
the  rotational  shearing  interferometer.^  Mechanical 
stability  problems  can  make  sampling  large  amounts  of 
coherence  data  difficult,  and  detecting  weak  signals  in 
noise  requires  long  integration  periods.  The  method 
used  by  the  ACS  is  related  to  other  techniques  such 
as  depth-by-defocus  imaging^®  and  phase  diversity 
imaging."^  Furthermore,  interpretation  of  data  from 
the  sensor  provides  new  insight  into  the  sampling  of 
coherence  in  standard  imaging  systems. 

The  ACS  consists  of  a  nonspherical  lens,  which  has 
independently  changeable  horizontal  and  vertical  focal 
lengths  fx  and  fy^  respectively.  Although  such  a  lens 
is  difficult  to  realize  in  practice,  here  we  introduce  a 
practical  substitute.  This  lens  is  placed  a  distance  z 
from  a  focal-plane  array  such  as  a  CCD,  and  the  hori¬ 
zontal  and  vertical  locations  on  the  CCD  relative  to  the 
center  axis  of  the  lens  are  positions  x  and  y,  respec¬ 
tively.  A  partially  coherent,  quasi-monochromatic 
field  with  mutual  intensity  J{x\,  yi,  X2,  y2)  is  incident 
on  the  aperture  of  the  lens.  The  intensity  measured 
by  the  focal-plane  array  is  then 
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If  we  make  the  substitutions  x\  —  x  A-  A:x:,  X2  =  i  —  A:ic, 
yi  =  y  +  Ay,  and  y2  =  y  “  Ay,  the  integral  becomes 
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We  make  another  set  of  substitutions,  Qx  =  xAx, 
dqx/\Ax\  =  dx,  Qy  =  yAy,  and  dqy/\Ay\  =  dy,  to  find 
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The  intensity-measurement  function  /(*)  of  Eq.  (3) 
contains  the  same  measurements  as  in  Eq.  (2)  re¬ 
sampled  to  new  coordinates.  Examination  of  Eq.  (3) 
reveals  that  there  is  a  4-D  Fourier-transform  relation¬ 
ship  between  the  following  quantities: 
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Every  sample  of  intensity  for  each  combination  of  the 
position  and  the  focal  lengths  of  the  lens  is  a  sample 
of  the  4-D  Fourier  transform  of  the  coherence  function. 
This  result  applies  equally  well  for  fx  =  fy^  so  stigmatic 
imagers  also  measure  samples  of  the  4-D  Fourier  trans¬ 
form  of  the  coherence  function,  but  they  are  unable  to 
sample  the  entire  Fourier  space. 

Because  the  ACS  can  measure  general  partially  co¬ 
herent  sources,  it  can  be  used  equally  well  with  coher¬ 
ent  or  incoherent  sources  and  can  distinguish  between 
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the  two.  This  ability  comes  at  the  expense  of  the  re¬ 
quirement  of  much  more  information  than  would  be  the 
case  if  the  coherence  state  of  the  source  were  known. 
Another  advantage  of  measuring  the  entire  coherence 
function  is  that  a  coherence-mode  decomposition  can 
be  performed.  This  decomposition  will  allow  the  con¬ 
tributions  of  individual  sources  to  be  separated.  With¬ 
out  the  entire  coherence  function,  we  will  need  to  know 
the  coherence  state  of  the  sources  a  priori  to  separate 
their  contributions.  The  coherence-mode  decomposi¬ 
tion  can  become  a  powerful  computational  technique 
for  augmenting  the  imaging  process.  In  addition,  if 
the  entire  coherence  function  is  known,  the  coherence 
can  be  found  after  propagation  through  any  linear  opti¬ 
cal  system,  including  any  other  optical  instrument.  A 
new  kind  of  image  processing  is  possible  in  which  the 
propagation  of  partially  coherent  light  can  be  digitally 
simulated. 

An  ACS  might  be  constructed  by  use  of  two  cylin¬ 
drical  lenses  of  focal  length  f  with  their  focal  axes 
placed  at  an  angle  B  relative  to  each  other,  symmet¬ 
ric  about  the  horizontal  axis.  The  effective  horizon¬ 
tal  and  vertical  focal  lengths  of  this  lens  are  given  by 
2  cos^(^/2)//'  =  1/f^  and  2  sin^(^/2)//  =  1/fy,  respec¬ 
tively.  To  achieve  any  given  values  of  1/fx  —  f/z  and 
1/fy  -  1/z,  one  need  only  set  0  and  the  distance  be¬ 
tween  the  lens  combination  and  the  CCD  2. 

Because  the  aperture  is  a  finite  size,  the  accessible 
region  of  the  4-D  coherence  function  will  be  limited. 
If  we  consider  a  square  aperture  of  side  d,  we  can  de¬ 
termine  the  accessible  region  of  the  coherence  space. 
To  keep  the  correlations  confined  within  the  aperture, 
we  require  that  lx  ±  Ax|  <  d  and  \y  ±  Ay\  <  d.  A 
plot  of  the  boundaries  denoted  by  these  inequalities 
is  given  in  Fig.  1.  Because  the  Fourier-space  param¬ 
eters  are  different  from  the  physical  parameters,  the 
region  of  the  Ax  and  Qx  Fourier  space  that  these  bound¬ 
aries  correspond  to  is  also  shown  in  Fig.  1.  Since  the 
Fourier  space  is  not  sampled  near  the  Qx  axis,  an  im¬ 
age  formed  by  a  finite-aperture  sensor  will  suffer  in 
resolution  along  this  dimension. 

We  built  an  ACS  using  three  lenses:  one  15-cm 
cylindrical  lens  used  for  one  axis  and  two  30-cm  cylin- 
(kical  lenses  used  for  the  other  axis.  A  diagram  of 
this  scheme  is  shown  in  Fig.  2.  Two  lenses  were  used 
for  one  axis  instead  of  one  lens  as  we  described  above 
so  that  the  principal  planes  of  focus  on  both  axes  could 
roughly  coincide.  The  two  lenses  for  one  axis  were 
always  turned  together.  There  were  two  computer- 
controlled  rotation  stages,  each  turning  one  axis  of  the 
ACS.  The  CCD  was  placed  on  a  computer-controlled 
translation  stage  so  that  the  distance  between  the 
lens  system  and  the  CCD  could  be  changed.  The 
translation  stage  had  a  travel  of  5  cm,  with  its  center 
position  being  15  cm  from  the  principal  planes  of 
the  lenses.  The  source  that  we  imaged  with  the 
ACS  was  three  red  LED’s  with  their  plastic  lenses 
sanded  off  to  make  their  radiation  patterns  more 
isotropic. 

The  data  acquisition  went  as  follows:  The  com¬ 
puter  stepped  through  64  values  of  1/fx  —  1/z  and 
1/fy  -  1/z  spaced  evenly  by  0.0035  m“^  for  a  total 
range  of  2.2  m"^  For  each  of  the  pairs  of  values 


the  computer  calculated  the  angle  B  and  distance  z 
needed  to  achieve  these  values.  If  the  position  could 
be  reached  by  the  translation  stage,  the  computer 
set  the  rotation  stages  at  equal  and  opposite  angles 
B  about  the  horizontal  axis  and  set  the  position 
of  the  stage.  The  computer  then  sampled  the  in¬ 
tensity  on  a  256  X  256  region  of  the  CCD  array, 
which  is  downsampled  by  use  of  a  band-limiting 
interpolator  to  64  X  64.  For  roughly  one  quarter 
of  the  images,  the  position  could  not  be  reached 
by  the  translation  stage,  so  the  computer  recorded 
zeros  for  the  picture  and  continued  sampling.  We 
recorded  a  total  of  4096  64  X  64  pixel  frames  in  this 
way  in  a  total  time  of  '-'12  h,  to  record  a  total  of 
2^^  samples. 

After  the  data  were  recorded,  they  were  processed 
to  find  the  coherent  modes.  First,  we  performed  a 
4-D  fast  Fourier  transform  of  dimensions  64  X  64  X 
64  X  64  on  the  data  to  compute  the  discrete  samples 
of  the  coherence  function  from  the  sampled  intensity. 
Then,  the  Lanczos  method  was  used  to  calculate  the 
approximate  eigenvalues  and  eigenvectors  of  the  co¬ 
herence  data,  which  correspond  to  the  coherent  modes. 
The  algorithm  was  adapted  for  this  purpose  by  ap¬ 
proximation  of  the  integral  that  defines  the  coherent¬ 
mode  eigenvalue  equation  with  a  discrete  sum: 


Fig.  1.  Portion  of  coherence  space  that  can  be  sampled  in  a 
two-dimensional  square  aperture  (shown  for  one  dimension 
only;  the  other  is  identical). 


Fig.  2.  Diagram  of  the  ACS.  Two  cylindrical  lenses  of 
300-mm  focal  length  form  Axis  1  and  focus  along  one  di¬ 
agonal  direction,  and  one  cylindrical  lens  of  150-mm  focal 
length  forms  Axis  2.  The  combination  of  the  two  foci,  ori¬ 
ented  at  equal  and  opposite  angles  to  the  vertical  axis,  ef¬ 
fectively  forms  a  single  lens  of  adjustable  astigmatic  focal 
ratio. 
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(A)  (B)  (C) 


Mode 

Source 
magnitude 
(arb  units) 

X  spatial 
bequency 

(m:*) 

Y  spatial 
frequency 
(m*) 

Curvature  of 
field  (m'^) 

Position 

X(m) 

Position 

Y<m) 

Distance 

Z(ni) 

A 

8.8610^ 

10400 

-7500 

3.98  10* 

0.0050 

-0.0036 

0.758 

B 

~T64W~ 

-15300 

700 

6  16  id* 

-0.0048 

.000216 

0.496 

C 

7.4310* 

8900 

11400 

3^8  10* 

0.0042 

0.0055 

0.758 

Fig.  3.  (A)~(C)  Three  coherent  modes  computed  from  the 
sample  coherence  data.  The  image  intensity  corresponds 
to  the  magnitude  of  the  real  component  of  the  unpolarized 
optical  field.  The  dimensions  of  the  images  are  3  mm  x 
3  mm.  The  magnitude,  spatial  frequency,  field  curvature, 
and  corresponding  positions  of  each  mode  is  shown  in  the 
table. 


E{r2)  =  \k  /  £(ri)J(ri,r2)dri -> 

J  A 

Ej  =  A*  -  rj,  >  (5) 

where  are  the  positions  of  the  points  of  interest  in 
the  aperture  (a  rectangular  array  here),  A/  are  the 
eigenvalues,  and  J(  * )  is  a  function  of  the  center  and 
difference  positions  of  the  correlated  points.  For  the 
points  at  which  no  data  for  J(  • )  were  gathered  owing 
to  the  limited  measurement  range  of  the  sensor,  we  set 
J(  * )  =  0.  We  expect  that  the  incomplete  data  will  ar- 
tificially  increase  the  number  of  coherent  modes  and 
result  in  a  coherence  function  that  is  no  longer  per¬ 
fectly  positive  definite. 

Figure  3  shows  the  coherent  modes  factored  from  the 
cross-spectral  density  by  the  Lanczos  method.^®  The 
primary  modes  are  all  spherical  waves,  but  there  were 
higher-order  modes  present  in  the  signal  because  the 
sources  were  not  perfectly  pointlike.  The  spatial- 
frequency  (plane-wave)  component  of  these  spheri¬ 
cal  waves  corresponds  to  their  angular  coordinates, 
whereas  the  curvature  of  the  wave  front  corresponds 
to  the  depth.  By  fitting  a  Fresnel  wave  front  to  each 
mode,  we  obtain 

where  x,  y,  and  z  are  the  position  of  the  source; 
and  Tiy  are  the  pixel  numbers  in  the  field;  and  d  = 
2.35  X  10"^  m  is  the  size  of  the  resolution  element 
with  which  the  field  was  measured.  The  lateral  dis¬ 
tance  between  the  first  and  third  LED’s  was  9  mm  as 


measured  with  a  ruler  and  9.1  mm  as  measured  with 
the  coherence  sensor.  The  distance  in  depth  between 
the  second  LED  and  the  other  two  was  245  mm  as  mea¬ 
sured  with  a  ruler  and  262  mm  as  measured  with  the 
sensor.  There  was  good  agreement  between  these  two 
methods,  showing  that  the  sensor  can  measure  coher¬ 
ent  modes  accurately. 

We  have  proposed  and  demonstrated  a  sensor  that 
can  sample  a  partially  coherent  field  and  uses  digital 
processing  in  the  form  of  a  discretized  coherent-mode 
transformation  to  identify  individual  sources  in  the 
field.  We  believe  that  such  sensors  will  be  useful  not 
only  for  three-dimensional  (3-D)  incoherent  sources 
such  as  those  that  were  imaged  here  but  also  for 
more-general  4-D  coherence  functions  in  which  dis¬ 
tortions  break  the  symmetry  associated  with  3-D 
coherence  propagation.^^  Because  in  the  ACS  every 
source  does  not  contribute  light  equally  to  every 
pixel  measured,  as  in  other  methods  of  sampling  3-E) 
structure  from  coherence,  such  as  the  rotational 
shearing  interferometer,  the  ACS  may  have  the 
advantage  of  reduced  noise  compared  with  that  of 
white-light  holography.  Also,  because  the  ACS  does 
not  employ  two  separate  interferometer  arms,  it  is  less 
sensitive  to  relative  motions  between  its  components. 
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Distorted  wavefronts  have  been  characteri7-ed  using  interferometry  [1], 
holography  [2],  phase  diversity  [3,  4],  modal  analysis  [5],  and  wavefront  sen¬ 
sors  [6].  A  distorted  wavefront  can  be  corrected  [7,  8]  using  adaptive  op¬ 
tics  [9],  liquid  crystal  phase  modulators  [10,  11,  12],  or  digital  deconvolution 
from  wavefront  sensing  [13,  14].  We  describe  here  a  method  of  digital  wave- 
front  sensing  and  deconvolution  based  on  the  recently  described  Astigmatic 
Coherence  Sensor  (ACS)  [15].  The  ACS  measures  the  four-dimensional  spa¬ 
tial  coherence  function  within  an  aperture.  In  this  paper  we  use  the  ACS  to 
digitally  characterise  and  correct  a  wavefront  distortion  in  an  imaging  sys¬ 
tem.  This  method  is  unique  in  that  it  employs  an  extremely  powerful  analytic 
tool  for  analyzing  partially  coherent  sources,  the  coherent-mode  decomposi¬ 
tion  [17].  This  method  can  only  be  employed  when  all  the  correlations  are 
measured  between  a  set  of  points,  as  the  ACS  does. 

The  ACS  consists  of  a  lens  combination  that  has  an  adjustable  horizontal 
to  vertical  focal  length  ratio.  A  sensor  array  placed  behind  the  lenses  and 
measures  the  intensity  of  the  field.  The  intensity  I{x,  y,  z)  is  measured  in 
the  x-y  plane  transverse  to  the  optical  axis  and  as  a  function  of  z,  the  dis¬ 
tance  from  the  sensor  array  to  the  principal  plane  of  the  lens  combination. 
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I{x,  y,  z)  is  related  to  the  mutual  intensity  of  the  quasi  monochromatic  field 
of  wavelength  A  in  the  aperture,  J{x  —  Ax,y  —  Ay,x  +  Ax,y  +  Ay),  by  a 
four-dimensional  Fourier  transform: 


V2’  2’  /x  2’  fy  2/ 
I  J(Ax,Ay,qa;.g„) 


exp{i^[4q,[j-^-l)+4qy{j-^ 
^  exp  (=^  [-4xAx  -  4yAy]j 


\ 


dqxdqydAxdAy 


/ 


(1) 


where  fx  and  fy  are  the  focal  lengths  of  the  astigmatic  lens  combination  along 
the  X  and  y  axes.  [15]  For  an  incoherent  source,  the  domain  of  J(-)  reduces 
to  three  dimensions,  because  incoherent  sources  produce  only  independent 
spherical  waves.  However,  when  incoherent  sources  are  imaged  through  a 
distortion,  the  distorting  medium  can  break  the  symmetry  of  spherical  waves, 
and  produce  independent  data  in  a  4-D  domain.  In  some  cases  knowledge 
of  the  4-D  mutual  intensity  can  be  used  to  recover  an  undi.storted  image  of 
the  original  source.  In  this  paper  we  use  measurements  of  J(-)  in  4-D  to 
compensate  for  an  isoplanatic  (inside  the  pupil)  phase  distortion. 

The  coherent-mode  decomposition  expresses  a  partially  coherent  field  as 
an  orthogonal  expansion  of  analytic  wavefronts  from  uncorrelated  sources; 
J(ri,r2)  =  5  \0i(j"i)0*(r2),  where  the  eigenvalues  Aj  corre.spond  to  the 

i 

power  emitted  from  each  source,  and  the  orthogonal  eigenfunctions  0i(r) 
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are  the  complex  wavefronts  from  each  source  in  the  entrance  pupil  S.  We 
consider  the  transmission  of  a  partially  coherent  wavefront  through  an  op¬ 
tical  system  from  an  entrance  pupil  S  to  an  exit  pupil  S'.  The  optical  sys¬ 
tem  has  a  coherent  transfer  function  where 

3 

the  Sj  are  positive  singular  values  and  the  and  are  the  or¬ 

thogonal  singular  functions  in  S  and  S' ,  normalized  to  one.  The  functions 

</)'(r'i)  =  J2SjS </),(r)i/?*(r)  dr  are  the  wavefronts  in  the  exit  pupil  of  the  en- 
3  s 

trance  function  for  each  coherent  mode.  We  can  then  calculate  the  overlap 

matrix  Pij  =  f  (t>'*{r'i)(t>j{r'2)  =  =  A'^S^A  (in  matrix  notation), 

S'  k  '  ' 

where  Ay  =  /0i(r)i/j*(r)  dr  and  Sf^  =  S^ij. 

The  matrix  P  is  determined  by  how  orthogonal  the  coherent  modes  are 
after  they  pass  through  the  sy.stem.  If  the  functions  4>i{r)  and  V’i(r)  form  a 
complete  set  within  S,  then  the  matrix  A  is  unitary,  and  the  decomposition 
P  =  A^S^A  is  a  eigenvalue  decomposition  of  P  with  eigenvalues  given  by 
S^.  Therefore,  they  have  the  same  eigenvalues,  determinant,  and  trace.  The 
values  Sj  correspond  to  the  fraction  of  power  in  the  entrance  wavefront  that 
projects  on  to  the  singular  function  ^|3j{r)  that  exits  the  pupil.  If  no  power 
is  lost,  the  Sj  =  1  and  the  P  =  I,  the  identity  matrix,  so  all  the  coherent 
modes  are  still  orthogonal  upon  leaving  the  exit  pupil.  However,  loss  of 
power  in  general  leads  to  a  loss  of  orthogonality  among  the  coherent  modes. 
As  a  result,  sources  that  are  uncorrelated  appear  partially  correlated  in  the 
aperture,  due  to  a  loss  of  information.  The  coherent  modes  at  the  exit  pupil 
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will  no  longer  correspond  one-to-one  with  input  modes.  This  can  be  seen 
when  looking  at  two  closely  spaced  point  sources  through  a  aperture  too 
small  to  resolve  them.  For  a  phase  distortion  placed  at  the  exit  pupil,  no 
power  can  be  scattered  out  of  the  optical  system  and  so  orthogonality  is 
preserved.  More  general  distortions  such  as  anisoplanatic  distortions  will  in 
general  scatter  light  away  from  the  exit  pupil,  and  the  coherent  modes  from 
which  the  most  light  is  diverted  will  probably  be  “mixed”  the  most  with 
other  modes. 

As  long  as  one  knows  that  a  given  optical  system  is  power-preserving, 
a  coherence-mode  decomposition  will  separate  the  wavefronts  due  to  inde¬ 
pendent  sources  even  without  knowledge  of  the  exact  transformation  between 
the  source  and  exit  pupil.  By  examining  the  wavefronts  due  to  several  inde¬ 
pendent  sources,  one  may  be  able  to  infer  information  about  the  intervening 
optical  system.  For  example,  if  a  phase  distortion  is  placed  in  the  pupil  of 
an  optical  system  viewing  a  planar  incoherent  source,  all  of  the  coherent 
modes  upon  exit  will  have  the  same  planar  distortion  on  them.  From  the 
coherent  modes,  one  may  be  able  to  simultaneously  deduce  the  distortion 
and  the  source  behind  it,  even  in  situations  when  the  sources  can  not  be  im¬ 
aged  separately  or  turned  on/off  in  sequence.  When  the  pupil  is  too  small, 
or  intervening  blockages  or  distortions  absorb  or  divert  power,  the  coherent 
modes  can  be  expected  to  mix  in  a  way  that  is  varies  continuously  with  the 
amount  of  lost  power  from  the  source.  Quantifying  this  “mixing”  of  the 
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coherent  modes  based  on  the  type  of  distortion  is  beyond  the  scope  of  this 
paper. 

Our  goal  is  to  image  a  test  object  through  an  unknown  distortion.  As 
illustrated  in  Figure  1,  we  use  the  ACS  to  measure  the  mutual  intensity  due 
to  the  test  object  and  a  point  reference  source  propagation  through  a  thin 
distorter.  Both  sources  are  quasi-monochromatic  with  the  same  nominal 
wavelength.  The  mutual  intensity  J{xi,yi,X2,y2)  of  the  combined  source  is 
the  sum  of  the  mutual  intensity  due  to  the  point  reference  and  the  test  ob¬ 
ject.  To  separate  the  contributions  of  the  two,  we  use  the  coherent  mode  de¬ 
composition.  [16,  17]  The  coherent  mode  decomposition  expands  the  mutual 
intensity  as  a  sum  of  coherent  fields  multiplied  by  uncorrelated  random  vari¬ 
ables:  J{xi,yi,X2,y2)  =  Ei  AjA(a;i,j/i)</>*(^2,y2)-  Since  the  fields  produced 
by  the  point  source  and  illuminated  transparency  will  be  uncorrelated,  we 
can  apply  the  coherent  mode  decomposition  to  the  mutual  intensity  to  find 
the  field  due  to  the  point  source  alone. 

We  assume  that  the  distortion  is  isoplanatic  with  a  pupil  function  T{x,  y) 
in  the  aperture.  This  distortion  transforms  the  mutual  intensity  into  Jd{xi,  yi,  X2, 
J{xi,yi,X2,y2)T{xi,yi)T*{x2,y2)-  Since  the  point  source  would  produce  a 
spherical  wave  coherent  mode  absent  the  distortion,  we  can  use  the  actual  co¬ 
herent  mode  of  the  point  source  to  characterize  the  distortion  T{x,  y).  After 
performing  the  coherent  mode  decomposition  on  J'(-),  we  find  the  coherent 
mode  (^1  (a;,  y)  corresponding  to  the  distorted  point  source  and  form  the  con- 


jugate  phase  distortion  0j(x,t/).  We  then  find  an  estimate  of  the  coherence 
function  before  distortion  J'(xi,  yi,  X2, 2/2)  =  2/1,  X2, 2/2)0i(^i.  2/2)- 

This  estimate  has  the  distortion  corrected,  and  also  images  the  transparency, 
because  (l)[{x,y)  also  conjugates  the  phase  due  to  propagation  of  the  field. 

We  then  use  a  4-D  inverse  Fourier  Transform  to  recover  the  intensity  an 
imaging  system  would  have  measured  at  the  in  focus  plane,  which  we  expect 
will  be  the  undistorted  image  of  the  source. 

Our  implementation  of  the  ACS  uses  three  lenses.  Two  of  the  lenses 
are  cylindrical  are  of  300  mm  focal  length  with  their  focal  axes  aligned  and 
rotated  to  an  angle  6/2  from  the  horizontal  axis.  The  third  lens  is  a  150 
mm  focal  length  cylindrical  lens  and  is  placed  between  the  other  two  with 
its  axis  placed  —9/2  from  the  horizontal  axis.  Together  they  form  a  lens 
with  horizontal  focal  length  1/ fx  =  2cos^(0/2)//  and  1//^^  =  2sin^(^/2)// 
vertical  focal  length,  where  /  =  150  mm.  The  reference  point  source  in  our 
experiments  was  a  4  mW  660  nm  laser  diode  attenuated  by  three  neutral 
density  filters  with  a  total  optical  density  of  4.6.  Unlike  a  normal  refer¬ 
ence  point  source  as  used  in  adaptive  optics,  our  source  was  not  a  separable 
wavelength.  Rather,  it  was  incorporated  to  inchide  an  object  in  the  scene 
of  sufficiently  high  spatial  bandwidth  to  reconstruct  the  distortion.  The  test 
object  was  a  laser  printer  transparency  made  diffuse  by  rubbing  the  back 
surface  with  sandpaper,  with  transparent  letters  “Ul”  surrounded  by  a  black 
opaque  background.  This  object  was  rear  illuminated  by  seven  red  LEDs. 
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The  light,  from  the  test  object  and  the  point  reference  was  combined  using 
a  beam  splitter.  The  objects  were  approximately  30  cm  from  the  aperture 
of  the  ACS.  The  distortion  plate  was  an  approximately  5  by  5  cm  square  of 
2  mm  thick  transparent  acrylic,  which  was  softened  by  heating  and  twisted 
into  a  distorting  shape.  It  was  placed  about  15  cm  in  front  of  the  ACS  to 
make  the  source  not  resolvable  by  a  standard  stigmatic  imager.  Figure  1 
shows  a  diagram  of  the  source  and  the  ACS.  Figure  2  shows  a  picture  of  the 
source  taken  through  the  distortion  before  correction.  We  note  that  with  the 
distortion,  the  images  of  the  laser  diode  and  transparency  are  inseparable. 

The  pixel  pitch  of  the  CCD  sensor  was  p  =  and  it  was  nominally 

located  I  =  185  mm  from  the  principal  plane  of  the  ACS.  To  acquire  intensity 
data,  9  and  the  CCD  range  were  adjusted  so  that  the  defocus  parameters 
l/Zr  —  1/^  were  stepped  through  combinations  of  64  positions 

0.034  m~^  apart  to  sample  a  total  range  of  2.13  m~^.  At  each  defocus 
setting,  a  64x64  region  of  the  CCD  was  sampled.  The  size  of  the  sampled 
region  was  proportional  to  the  distance  z  away  from  the  principal  plane. 
A  bandlimiting  interpolator  resampled  the  pixels  to  have  a  spacing  slightly 
above  or  below  19pm  as  needed.  The  resolution  of  the  measured  coherence 
was  d  =  ^  =  96  pm.  Ultimately  4096  images  were  recorded  in  12  hours. 

We  recovered  a  deblurred  image  from  the  coherence  data  by  the  following 
steps: 

1.  The  data  from  the  ACS  was  measured  as  a  64x64x64x64  discretized 
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version  of  I{x/ z,y/z,\l fx  —  1/^,  1/ fy  —  I/2).  The  sampling  rate  in 
the  xjz  and  y/2  variables  was  1.02  10“'*,  and  the  sampling  rate  in 
1/ fx  —  I/'S  and  l/fy  —  l/z  was  0.034  m“*.  Using  a  radix-2  4-D  real- 
to-complex  FFT  this  was  converted  to  the  discrete  coherence  samples 
J{Ax,Ay,xAx,yAy)/\AxAy\.  This  data  set  was  only  32x64x64x64 
because  it  was  the  Fourier  transform  of  a  real  function. 

2.  We  then  multiplied  the  4-D  coherence  by  a  filter  |Aa:Ay|  to  eliminate 
the  Ax  Ay  factor  in  Eqn.  1.  To  avoid  the  loss  of  this  data  for  J(-)  such 
that  Aa:  =  0  or  Ay  —  0,  we  multiplied  by  a  small  number  (0.5)  instead 
of  zero. 

3.  We  used  the  Lanczos  sparse  matrix  eigenvalue  algorithm  [18]  find  the 
coherent  mode  decomposition  of  J(-).  This  was  done  by  discretizing 
the  integral  that  defines  the  coherent  mode  decomposition: 

0 (r2)  =  Afe y  0 (ri)  J (ri, r2)dri  0^  =  XkYl 
A  ^ 

(2) 

where  Fj  are  the  positions  of  the  points  of  interest  in  the  aperture, 
the  Aj  are  the  eigenvalues,  and  J  (•)  is  a  function  of  the  center  and 
difference  positions  of  the  correlated  points.  In  the  Lanczos  algorithm, 
the  sampling  points  of  J(-)  and  0(-)  do  not  coincide  because  they  are 
measured  on  separate  coordinate  systems.  To  perform  the  matrix- 
vector  multiply  step  in  the  algorithm,  a  quadrilinear  interpolator  was 
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used  to  find  samples  of  J(-)  from  the  16  nearest  samples. 

4.  We  found  the  64x64  sampled  field  corresponding  to  the  highest  eigen¬ 
value  coherent  mode  (l)i{x,y),  which  was  due  to  the  laser  diode.  This 
field  is  sampled  with  a  period  of  96  fj,m.  The  real  part,  of  this  analytic 
field  is  shown  in  Figure  3,  and  the  image  dimensions  are  6. 1x6.1  mm. 


5.  We  computed  an  inverse  filter  0'(a:,  y)  from  this  using  the  following: 

(l>*i{x,y) 


(t)'{x,  y)  = 


|</>i(a;,  y)|  +  o.oi(/>„ 


(3) 


This  essentially  produced  a  filter  with  a  conjugate  phase  to  the  distor¬ 
tion.  The  (l)max  term  is  the  maximum  magnitude  of  the  field  within  the 
aperture  and  was  added  to  suppress  noisy  field  points  with  low  magni¬ 
tudes.  This  is  a  noise  reduction  approach  similar  to  that  of  a  Wiener 
filter. 


6.  We  formed  a  nonblurred  sampled  coherence  function: 

J'{Ax,  Ay,  xAx,  yAy)  = 

J{Ax,  Ay,xAx,yAy)<f)'{x  -  Ax,y  -  Ay)4>'*{x  +  Ax,y->t  Ay)/\AxAy\ 

(4) 

The  denominator  was  added  to  reverse  step  2  so  we  can  convert  the 
result  back  to  intensity  data.  When  Ax  or  Ay  is  zero,  we  multiply  the 
sample  by  2  to  reverse  the  0.5  factor  of  step  2  for  these  points.  Since, 
as  in  step  3,  the  samples  of  J(-)  and  </>'(•)  do  not  coincide,  a  bilinear 
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interpolation  of  (/>'(•)  is  performed  between  the  nearest  4  neighbors  of 
a  needed  point. 

7.  We  used  a  4-D  inverse  complex-to-real  FFT  to  reverse  step  1  and  re¬ 
cover  /(a;/z,  y/2, 1//*  -  l/z,  1/fy  -  l/z) 

8.  Finally,  the  plane  of  data  corresponding  to  the  in  focus  image  was 
extracted,  and  is  displayed  in  Figure  4. 

We  believe  that  the  legibility  of  the  letters  has  been  substantially  improved. 
Also  note  that  the  reference  diode  is  pointlike,  meaning  the  blurring  of  the 
laser  diode  has  been  successfully  removed.  The  image  of  the  diode  is  not  a 
single  pixel  because  the  bandwidth  of  the  imaging  system  was  too  small  to 
image  it  as  one  pixel. 

We  have  demon.strated  that  the  4-D  coherence  of  a  non-stigmatic  source 
such  as  illuminated  blurred  text  can  be  sampled  by  the  ACS.  With  the  entire 
coherence  sampled,  we  can  digitally  simulate  the  propagation  of  partially  co¬ 
herent  light  to  apply  an  inverse  filter  and  recover  the  unblurred  image.  We 
believe  that  these  methods  represent  a  powerful  application  of  coherence  the¬ 
ory  to  imaging  and  may  ultimately  benefit  microscopy,  astronomical  imaging, 
and  imaging  through  turbulence.  Since  detailed  knowledge  of  the  coherent 
transfer  function  of  the  system  may  not  be  required  apriori,  measurement 
of  the  4-D  coherence  and  subsequent  decomposition  may  provide  a  powerful 
way  of  passively  inferring  details  about  intervening  optical  systems. 
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Figure  1:  Diagram  of  the  setup  of  the  source  and  Astigmatic  Coherence 
Sensor. 
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Figure  2:  Test  object  and  reference  viewed  with  a  spherical  lens  with  distor¬ 
tion. 
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Figure  3:  Real  part  of  the  analytic  field  of  the  distortion  as  determined  by 
coherent  mode  expansion. 
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Figure  4:  Test  object  and  reference  viewed  with  a  spherical  lens  with  distor¬ 
tion. 
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Abstract:  The  morphology  of  three-dimensional  foams  is  of  interest 
to  physicists,  engineers,  and  mathematicians.  It  is  desired  to  image  the 
3-dimensional  structure  of  the  foam.  Many  different  techniques  have 
been  used  to  image  the  foam,  including  magnetic  resonance  imaging, 
and  short- focal  length  lenses.  We  use  a  camera  and  apply  tomographic 
algorithms  to  accurately  image  a  set  of  bubbles.  We  correct  for  the 
distortion  of  a  curved  plexiglas  container  using  ray-tracing. 
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1  Introduction 

Light’s  interaction  with  soap  bubbles  creates  colorful  patterns  that  vividly  illustrate 
the  rudimentary  principle  of  wave  interference.  But  there  is  a  lot  more  to  learn  about 
soap  bubbles.  In  a  cluster  they  serve  as  a  model  for  many  cellular  systems  occurring  in 
nature.  At  low  liquid  content,  they  are  organized  into  an  intricate  network  of  polyhedral 
foam  adhering  to  certain  geometric  rules  discovered  by  Plateau  more  than  a  century  ago 
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Fig.  1.  A  CCD  video  image  of  polyhedral  aqueous  foam  showing  the  network  of 
vertices  and  edges.  The  camera  is  set  at  a  large  depth  of  field  to  reveal  the  interior 
features. 

[1].  Scientists  are  interested  in  how  energy  and  entropy  extremum  principles  determine 
the  partition  of  space  by  soap  bubbles.  This  motivates  a  technique  capable  of  resolving 
the  coordinates  of  vertices  and  edges  of  bubbles  in  foam. 

Polyhedral  aqueous  foam  made  with  soap  solution  looks  like  an  open  face  structure 
because  of  soap  film’s  transparency.  The  internal  features  are  revealed  to  the  extent 
that  light  rays  can  maintain  straight  paths  before  they  are  scattered  and  absorbed  by 
the  liquid  borders.  Fig.  1  shows  the  polyhedral  network  of  vertices  and  edges  captured 
by  a  video  camera  with  a  large  depth  of  field. 

Durian  and  his  colleagues  have  developed  a  multiple  light  scattering  technique  to 
study  foam  [2].  It  works  by  approximating  light  propagation  through  foam  as  a  dif¬ 
fusion  process.  Light  transmitted  through  a  sample  is  measured  and  correlated  with 
average  bubble  size.  Durian’s  method  has  been  demonstrated  to  work  suitably  with 
foam  densely  packed  with  small  spherical  bubbles  of  radius  less  than  50/xm.  However,  it 
cannot  provide  information  about  the  geometry  of  foam  with  polyhedral  cells.  To  this 
end,  attempts  to  measure  the  vertices’  position  and  their  connectivity  would  succeed  by 
scanning  a  focal  plane  of  a  CCD  camera,  adjusted  to  small  depth  of  field,  through  the 
layers  of  bubbles;  internal  features  concealed  in  one  direction  are  usually  observable  in 
other  directions.  Monnereau  and  Vignes- Adler  have  used  this  technique  to  reconstruct 
a  cluster  of  up  to  50  bubbles  [3,  4].  The  main  disadvantage  of  this  method  is  that  image 
processing  is  needed  to  pick  out  the  vertices  from  a  set  of  noisy  two-dimensional  data 
slices.  Vertices  outside  the  focal  plane  are  superimposed  on  data  slices  and  thus  make 
the  resolution  process  difficult.  Another  approach  to  the  foam  imaging  problem  is  to 
create  a  three-dimensional  data  volume  by  tomography.  Magnetic  resonance  imaging 
(with  tomographic  algorithms)  has  been  employed  to  examine  the  interior  of  foam  with 
various  degrees  of  success  [5]. 

In  this  paper,  we  use  Feldkamp’s  conebeam  tomographic  algorithms  [6,  7,  8,  9]  to 
reconstruct  a  three-dimensional  foam.  In  the  optical  domain,  we  take  many  pictures  of 
the  object  from  different  angles.  These  pictures  are  then  processed  by  the  conebeam 
algorithm  to  reconstruct  the  three-dimensional  volume. 

One  advantage  of  this  technique  is  that  both  the  conebeam  algorithm  and  the  image 
processing  both  are  designed  to  require  no  human  intervention.  This  will  speed  up  our 
rate  of  taking  data,  making  it  possible  to  analyze  larger  and  more  complex  data  sets. 
The  time  scale  of  this  technique  is  also  important.  Currently  we  are  taking  1  scan  in  a 
time  of  approximately  5  minutes,  a  time  which  could  be  reduced  by  taking  images  at 
video  rate  instead  of  still  pictures.  Since  the  time  scale  of  the  bubble  development  is  on 
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Fig.  2.  Top.  Experimental  setup.  The  bubbles  are  in  a  cylindrical  plexiglas  container, 

[  that  is  placed  on  a  rotation  stage.  The  plexiglas  container  is  held  in  a  mount  such 

that  it  is  centered  on  the  center  of  the  rotation  stage.  A  lightbox  (a  flat  box  with 
fluorescent  lights  that  provides  a  uniform  white  light)  is  placed  behind  the  cylinder, 
f  so  that  the  camera  sees  the  silhouetted  image.  The  computer  controls  the  rotation 

I  stage,  and  the  computer  also  acquires  images  from  the  digital  camera.  Bottom. 

As  shown  above,  the  image  rotates  around  on  a  stage,  and  the  camera  remains 
stationary.  However,  it  is  equivalent  to  view  the  object  as  stationary,  while  the 
1  camera  rotates.  The  positions  that  the  camera  acquires  an  image  at  are  referred  to 

5  as  the  vertex  points.  The  x,  y,  and  z  axes  travel  with  the  camera. 


the  order  of  hours,  we  will  be  able  to  take  several  images  as  the  bubbles  evolve. 

An  experimental  problem  that  we  encountered  was  that  the  container,  a  plexiglas 
cylinder,  that  held  the  bubbles  distorted  the  ray  path.  Using  ray-tracing  we  were  able 
to  compensate  for  this  distortion.  This  distortion  compensation  may  have  applications 
to  a  wide  range  of  tomography  problems. 

Our  experimental  results  show  a  reconstruction  of  a  test  object,  using  the  distortion 
correction  algorithm.  In  future  work,  we  will  use  a  matched  filter  to  extract  the  three- 
dimensional  positions  of  the  vertices. 


2  Optical  System  Design  and  Algorithm 

The  experimental  setup  consists  of  an  object  mounted  on  a  rotating  stage.  A  schematic 
of  the  setup  is  shown  in  Fig.  2  (top).  The  bubbles  are  in  a  cylindrical  plexiglas  container, 
that  is  placed  on  a  rotation  stage.  The  cylinder  had  an  index  of  refraction  of  n  =  1.49,  an 
inner  radius  of  U^ner  ”  2.54cm,  and  an  outer  radius  of  —  3.17cm.  The  plexiglas 

container  is  held  in  a  mount  such  that  it  is  centered  on  the  center  of  the  rotation  stage. 
A  lightbox  (used  in  photography,  the  lightbox  is  a  flat  box  with  fluorescent  lights  that 
provides  a  diffuse  white  light)  is  placed  behind  the  object,  so  that  the  camera  records 
the  silhouette  of  the  object.  The  computer  controls  the  rotation  stage,  and  the  computer 
also  acquires  images  from  the  digital  camera. 

Our  goal  is  to  image  the  edges  of  the  bubbles,  which  should  show  as  lines  on  a 
silhouette  image.  Under  optimal  lighting  conditions,  the  edges  will  appear  as  lines, 
while  the  faces  will  appear  transparent.  However,  we  do  observe  some  scatter  from  the 
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Cone-beam  tomography  with  a  digital  camera 


Daniel  L  Marks,  Ronald  Stack,  Andrew  J.  Johnson,  David  J.  Brady,  and 
David  C.  Munson,  Jr. 


We  show  that  x-ray  computer  tomography  algorithms  can  be  applied  with  minimal  alteration  to  the 
three-dimensional  reconstruction  of  visible  sources.  Diffraction  and  opacity  affect  visible  systems  more 
severely  than  x-ray  systems.  For  camera-based  tomography,  diffraction  can  be  neglected  for  objects 
within  the  depth  of  field.  We  show  that,  for  convex  objects,  opacity  has  the  effect  of  windowing  the 
angular  observation  range  and  thus  blurring  the  reconstruction.  For  concave  objects,  opacity  leads  to 
nonlinearity  in  the  transformation  from  object  to  reconstruction  and  may  cause  multiple  objects  to  map 
to  the  same  reconstruction.  In  x-ray  tomography,  the  contribution  of  an  object  point  to  a  line  integral 
is  independent  of  the  orientation  of  the  line.  In  optical  tomography,  however,  a  Lambertian  assumption 
may  be  more  realistic.  We  derive  an  expression  for  the  blur  function  (the  patch  response)  for  a  Lam¬ 
bertian  source.  We  present  experimental  results  showing  cone-beam  reconstruction  of  an  incoherently 
illuminated  opaque  object.  ©  2001  Optical  Society  of  America 
OCIS  codes:  100.6950,  100.6890,  110.6880,  150.6910. 


1.  Background 

Three-dimensional  (3-D)  imaging  has  important  ap¬ 
plications  to  machine  vision,  radiometry,  animation, 
modeling,  microscopy,  and  source  characterization. 
3-D  imaging  has  been  implemented  by  machine- 
vision  techniques,  such  as  stereo  vision,^  depth  by 
defocus,2”4  and  structured  illumination  and  depth 
cues,i  and  physical  optics  techniques,  such  as  confo- 
cal  microscopy,®  coherence  tomography,® lidar,®  and 
coherence  imaging.^  Although  each  of  these  tech¬ 
niques  has  been  successful  in  certain  situations,  none 
is  universally  applicable.  We  consider  here  a  strat¬ 
egy  for  reconstruction  of  incoherent  sources  based  on 
x-ray  computer  tomography.  Although  our  tech¬ 
nique  is  also  not  completely  general,  it  requires  only 
weak  assumptions  about  the  nature  of  the  source  and 
illumination  when  compared  with  t3q)ical  machine- 
vision  systems,  and  it  reconstructs  over  a  wider  solid 
angle  and  with  greater  3-D  resolution  when  com¬ 
pared  with  typical  physical  optical  systems.  The 
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drawbacks  of  our  approach  are  that  it  involves  poten¬ 
tially  unrealistic  assumptions  about  opacity  and 
transmittance,  that  it  works  well  only  over  the  finite 
depth  of  field  of  a  planar  imaging  system,  that  it  is 
computationally  intensive,  and  that  it  reconstructs 
full  volume  data  even  for  surface  objects.  Neverthe¬ 
less,  cone-beam  tomography  is  a  useful  benchmark 
for  the  potential  of  3-D  visible  imaging. 

Our  goal  is  to  estimate  the  3-D  radiant  power  den¬ 
sity  of  an  incoherent  or  Lambertian  source.  We 
achieve  this  goal  in  two  steps.  First,  we  use  a  lens- 
based  camera  to  gather  images  of  the  source  from 
many  perspectives.  We  interpret  the  images  as  lin¬ 
ear  projections  through  the  source.  Second,  we  ap¬ 
ply  a  cone-beam  tomography  algorithm  to  these 
projections  to  estimate  the  3-1)  power  density  of  the 
source. 

Computer  tomography!^  is  the  reconstruction  of  a 
source  or  scatterer  from  integrals  along  lines  or 
planes  projected  through  the  source  volume.  Stan¬ 
dard  approaches  are  grouped  into  parallel-beam,  fan- 
beam,  and  cone-beam  techniques.  Parallel-beam 
systems  measure  the  object  transmittance  for  plane- 
wave  illumination.  Fan-beam  systems  measure  the 
transmittance  along  rays  projected  from  a  point 
source  in  a  planar  slice.  The  rays  are  confined  to  a 
plane  by  a  slit  between  the  point  source  and  the 
object.  Cone-beam  systems  measure  the  transmit¬ 
tance  along  rays  projected  in  a  3-D  solid  angle  from  a 
point  source.  For  a  variety  of  technical  and  safety 
reasons,  x-ray  systems  until  recently  have  been  con- 
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Fig.  1.  Optical  imaging  in  cone-beam  tomography. 


fined  primarily  to  fan-beam  geometries.  The  con¬ 
straints  that  promote  fan-beam  geometries  for  x  rays 
do  not  apply  in  the  visible,  however,  because  visible 
illumination  is  relatively  safe  and  large  electronic 
visible  sensor  planes  are  ubiquitous.  In  short,  visi¬ 
ble  systems  are  better  suited  to  cone-beam  algo¬ 
rithms. 

In  cone-beam  tomography,  linear  projections 
through  an  object  are  gathered  in  discrete  sets,  where 
each  set  shares  a  common  point  of  intersection,  called 
the  vertex  point.  A  two-dimensional  (2-D)  set  of  pro¬ 
jections  is  gathered  at  each  vertex  point,  parameter¬ 
ized  by  the  direction  vector  of  rays  projecting  from  the 
vertex  point.  To  acquire  3-D  data,  the  point  moves 
along  a  prescribed  path,  called  the  vertex  path,  gath¬ 
ering  projections  that  pass  through  each  point  along 
the  path.  Figure  1  shows  the  circular  vertex  path  of 
a  sensor  around  an  object  volume.  A  complete  3-D 
cone-beam  data  set  is  parameterized  by  position 
along  the  vertex  path  and  projection  direction. 
Many  different  algorithms  have  been  developed  to 
reconstruct  a  3-D  volume  from  cone-beam  data.  Ex¬ 
act  reconstruction  is  possible  for  certain  vertex  paths, 
although  incomplete  paths  are  often  used  for  imple¬ 
mentation  simplicity.  In  this  paper  we  do  not  con¬ 
sider  the  relative  merits  of  different  algorithms. 
Rather,  we  show  that  x-ray  cone-beam  techniques 
can  be  applied  with  minimal  modification  to  visible 
spectrum  imaging. 

The  visible  imaging  problem  differs  from  the  x-ray 
problem  in  a  number  of  respects.  Whereas  x-ray 
systems  generally  require  artificial  illumination,  vis¬ 
ible  systems  rely  on  ambient  or  spatially  and  spec¬ 
trally  incoherent  sources.  Whereas  x-ray  systems 
achieve  acceptable  resolution  without  compensating 
for  diffraction,  diffraction  compensation  by  lenses 
and  mirrors  is  readily  available  and  highly  desirable 
in  the  visible  spectrum.  Whereas  x-ray  targets  are 
quasi-transparent,  most  visible  targets  are  opaque. 
X-rays  are  difficult  and  dangerous  to  generate  and 
detect;  visible  sources  and  detectors  are  well  devel¬ 
oped  and  safe.  These  differences  lead  to  changes  in 
the  implementation  of  cone-beam  imaging  for  the  vis¬ 
ible  spectrum.  In  contrast  with  x-ray  systems  in 
which  the  vertex  point  coincides  with  a  point  source, 
in  Sections  2  and  3  of  this  paper  we  describe  how  the 
vertex  point  for  self-luminous  or  ambiently  illumi¬ 


nated  incoherent  visible  imaging  can  be  associated 
with  a  point  in  the  principal  plane  of  a  visible  lens 
and  sensor  assembly  (e.g.,  a  camera).  In  the  x-ray 
system  the  source  point  and  the  sensor  plane  move  in 
tandem  around  the  vertex  path  on  opposite  sides  of 
the  object.  In  the  visible  system  only  the  camera 
moves  about  the  object.  In  Section  4  we  consider  the 
opacity  issue  and  derive  an  expression  for  the  patch 
response  of  a  Lambertian  source.  In  Section  5  we 
discuss  criteria  for  selecting  sampling  points  along 
the  visible  vertex  path  and  consider  the  resolution 
one  can  expect  in  the  reconstruction.  In  Section  6 
we  describe  experimental  demonstrations  of  the 
methods  we  consider. 

Use  of  tomography  to  determine  the  shape  and 
radiant  intensity  of  a  visible  source  may  seem  ineffi¬ 
cient,  especially  given  that  many  incoherent  and  all 
Lambertian  sources  are  surface  radiators.  Ulti¬ 
mately  a  2-D  surface  map  may  be  all  that  is  desired, 
yet  cone-beam  tomography  requires  a  3-D  set  of  pro¬ 
jections  to  determine  this  surface.  In  machine- 
vision  applications  economy  is  paramoimt,  and  this 
method  may  seem  impractical.  However,  increas¬ 
ingly  complex  and  disconnected  surfaces  begin  to  re¬ 
semble  volume  objects.  This  method  may  be  utilized 
on  transparent  and  semitransparent  visible  sources 
such  as  biological  tissues,  so  it  has  sufficient  versa¬ 
tility  and  generality  to  be  used  with  many  instru¬ 
ments  such  as  microscopes.  Also,  use  of  tomography 
avoids  the  need  to  register  landmark  points  between 
the  images;  the  only  information  needed  is  the  posi¬ 
tion  and  orientation  of  the  camera  in  space  for  each 
image.  Tomographic  algorithms  are  pure  linear  in¬ 
versions  and  do  not  require  decision  making  for  com¬ 
putation.  Because  the  end  result  is  a  3-D  power- 
density  estimate,  the  algorithm  makes  no  decisions 
about  the  location  of  surfaces.  The  patch  response 
described  below,  however,  can  be  combined  with  ex¬ 
isting  segmentation  algorithms  to  abstract  surfaces 
from  volumetric  data.  Although  perhaps  data  inten¬ 
sive  and  computationally  expensive,  we  believe  that 
the  decreasing  cost  and  increasing  ubiquity  of  CCD 
and  complementary  metal-oxide  semiconductor 
(CMOS)  imagers,  as  well  as  faster  computers,  will 
increasingly  justify  robust,  flexible,  and  general- 
purpose  3-D  techniques.  This  could  favor  cone- 
beam  tomography  as  a  practical  approach  to  image 
fusion. 

2.  Cameras  and  Cone-Beam  Projections 

The  goal  of  cone-beam  tomography  is  to  reconstruct 
the  3-D  source  density  function  D{y)  from  projections 
through  a  set  of  vertex  points.  The  projections  can 
be  expressed  as 

p{t,  p)  =  I  D(t  +  ap)da,  (1) 

where  t  is  the  vertex  point  and  p  is  a  vector  along  the 
projection  direction.  The  geometry  of  these  projec¬ 
tions  is  shown  in  Fig.  2.  A  family  of  projections  is 
captured  at  each  vertex  point.  Several  optical  sys- 
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Fig.  2.  Coordinate  system  that  defines  the  projections,  t  is  the 
vertex  point  for  a  family  of  projections  and  p  is  a  direction  vector 
along  a  particular  projection. 


terns  capture  projections  of  this  approximate  form. 
In  previous  research,  we  considered  tomographic 
reconstruction  from  projections  of  this  type  using  pin¬ 
hole  cameras,  coherence  imagers,  and  cubic-phase- 
aberrated  systems.®’i2,i3  Although  any  of  these 
systems  might  be  used  with  cone-beam  algorithms,  in 
this  paper  we  focus  more  on  the  applicability  of  the 
algorithms  themselves  to  visible  imaging  and  less  on 
optical  design  issues.  Accordingly,  we  limit  our  at¬ 
tention  here  to  imaging  with  a  standard  lens-based 
camera. 

Consider  the  camera  geometry  shown  in  Fig.  3. 
An  object  a  distance  z  from  the  input  principal  plane 
of  the  camera  is  imaged  a  distance  z'  behind  the 
output  principal  plane.  Newton’s  equations^^  relate 
the  ratio  of  the  image  cross  section  y'  to  the  object 
cross  section  y  asy'/y  =  +  /*)  =  (^'  -h  f)lf .  f 

and  f  are  the  focal  lengths  of  the  source  and  image 
spaces,  respectively.  From  these  equations  one  con¬ 
cludes  thatyV^^'  =  or  that  the  slope  of 

the  angle  the  image  subtends  to  the  optical  axis  is 
proportional  to  the  slope  the  source  subtends  to  the 
axis.  The  images  of  sources  that  share  the  same 
slope  y/z  will  have  their  images  centered  at  the  same 
position  on  the  image  plane.  Each  sensor  location 
on  the  image  plane  can  be  considered  to  measure  the 
total  power  from  all  the  sources  along  the  same  slope 
y/z,  which  is  a  projection  of  the  source  that  intersects 
the  center  of  the  source  principal  plane.  The  projec¬ 
tions  then  form  a  cone,  so  that  the  image  plane  mea¬ 
sures  the  cone-beam  projections  of  the  source,  with 
the  vertex  point  being  the  center  of  the  source  prin¬ 
cipal  plane.  Under  the  assumption  that  all  source 


points  form  point  images,  the  image  on  the  output 
plane  of  the  camera  is 


p(0,  r)  =  Z>(Kzp^,  Kzp^,,  z)dz,  (2) 

Jo 

where  p  is  the  position  on  the  image  plane  and  k  = 
-f  lfz\  Equation  (2)  corresponds  to  Eq.  (1)  for  the 
vertex  point  t  =  0  and  p  =  (kp^,  Kp^,  1).  We  obtain 
a  complete  set  of  vertex  points  and  projections  by 
moving  the  camera  around  the  object  volume.  We 
note  that  these  projections  are  already  weighted,  so 
projections  specified  this  way  do  not  need  the  weight¬ 
ing  factor  of  Eq.  (7). 

Our  derivation  of  Eq.  (2)  neglects  the  fact  that 
Newton’s  equations  are  not  satisfied  for  a  fixed  image 
plane  as  we  vary  the  object  range.  When  the  object 
and  image  planes  satisfy  the  Newton  equations,  all 
rays  from  a  point  on  the  object  converge  to  a  single 
point  on  the  image.  When  we  shift  the  object  plane 
without  shifting  the  image  plane,  rays  from  an  object 
point  no  longer  cross  in  the  image  plane,  and  the 
image  becomes  defocused.  The  longitudinal  range 
over  which  the  object  planes  are  approximately  in 
focus  for  a  given  image  plane  is  termed  the  depth  of 
field.  Regions  of  the  source  that  are  outside  the 
depth  of  field  will  be  so  blurred  that  Eq.  (2)  cannot  be 
considered  accurate.  We  can  address  this  discrep¬ 
ancy  by  adjusting  the  camera  aperture  size  or  apo- 
dization  to  extend  the  depth  of  field  or  by  using  high 
depth-of-field  imagers,  such  as  the  cubic-phase  aber- 
ration^^>^®  or  interferometric  imagers.^ 

To  consider  approximate  depth  of  field  in  more  de¬ 
tail,  we  rederive  Eq.  (2)  using  diffraction  integrals. 
For  simplicity  we  limit  our  attention  to  a  thin-lens 
imaging  system.  For  such  a  system,  the  optical  im¬ 
age  field  v|i(rO  at  a  distance  z'  behind  the  lens  that  is 
due  to  the  object  field  vli/>(r)  a  distance  z  in  front  of  the 
lens  is 


i|i(rO  =  exp  hr 


iT|r'|^\  t  (  TT|rp 


X  r  +  —  r',  z  )dr,  (3) 


where 


Object  Object  Image  Image 

Focal  Principal  Principal  Focal 

Plane  Plane  Plane  Plane 


Fig.  3.  General  stigmatic  optical  system. 


h{r,  2^)  =  I 


V  ,  2tt 

)exp|7  — r-r' 


\  \z 


dr".  (4) 


f(r")  is  the  pupil  function  for  the  lens  aperture  and  f 
is  the  focal  length  of  the  lens.  With  no  aberration, 
t{r")  =  1  inside  the  aperture  and  zero  outside  the 
aperture.  The  camera  detects  the  intensity  on  the 
image  plane  P(r')  =  <|4i(r')|^).  If  the  object  field  is 
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incoherent  such  that  <4'n(ri,  z^)  = 

Z)(ri)8(ri  -  r2),  then  the  detected  signal  is 


P(r') 


'.(r  +  ir',.) 


2 

dr, 


(5) 


where  dr  represents  a  3-D  integral  over  the  trans¬ 
verse  components  in  r  and  the  longitudinal  compo¬ 
nent  2. 

In  going  from  Eq.  (3)  to  Eq.  (5)  we  added  an  integral 
over  z  on  the  assumption  that  D{t)  is  the  primary 
source  radiance  or  scattering  efficiency  of  the  object, 
which  is  not  generally  equal  to  the  optical  intensity  at 
r.  In  summing  the  contributions  to  P(r')  over  z  we 
assume  that  the  camera  response  is  linear  in  inten¬ 
sity.  Equation  (5)  is  a  correct  but  not  necessarily  a 
imique  means  of  expressing  the  focal  plane  projec¬ 
tions  in  terms  of  the  source  density.  Equation  (5) 
generally  cannot  be  inverted  to  recover  Z>(r).  To  see 
this,  one  need  only  note  that  any  allowed  P(rO  can  be 
obtained  simply  by  making  the  intensity  in  the  in¬ 
focus  plane  proportional  to  the  target  focal  plane 
value.  If,  however,  Eq.  (5)  can  be  viewed  as  a  pro¬ 
jection  through  the  vertex  point  r'  ==  0,  then  it  can  be 
inverted  with  projections  through  other  vertex  points 
to  imambiguously  recover  D(r).  In  principle,  the 
measurement  of  P(y')  along  a  vertex  path  can  deter¬ 
mine  D(r)  even  if  it  cannot  be  reduced  to  cone-beam 
projections,  but  we  do  not  consider  this  possibility  in 
this  paper. 

Equation  (5)  is  equivalent  to  Eq.  (2)  if /i(r,  z)  =  8(r). 
In  this  case  the  assumption  that  the  camera  captures 
cone-beam  projections  is  valid.  Referring  to  Eq.  (4), 
we  can  see  that  /i(r,  z)  is  an  approximate  delta  func¬ 
tion  so  long  as 


\ 


<1, 


where  A  is  the  aperture  of  the  lens.  This  implies  a 
depth  of  field  in  the  object  space  of  Az  JF^X,  where 
F  =  z/A  is  the  /-number  for  the  imaging  system. 
One  can  always  improve  the  depth  of  field  by  reduc¬ 
ing  the  aperture,  but  this  course  also  reduces  the 
transverse  resolution  by  blurring  /i(r,  z).  In  the  re¬ 
mainder  of  this  paper,  we  assume  that  the  object 
space  lies  completely  within  the  depth  of  field  and 
that  Eq.  (2)  is  valid. 

We  assume  that  our  camera  captures  cone-beam 
projections  covering  the  object  space  as  it  moves 
along  a  vertex  path.  The  vertex  point  t  for  a  given 
camera  position  is  the  center  of  the  principal  plane  of 
the  camera’s  imaging  system.  Projections  are  cap¬ 
tured  on  the  camera’s  focal  plane  for  rays  along  p  = 
!)•  This  approach  to  gathering  pro¬ 
jections  differs  from  the  standard  approach  for  x-ray 
cone-beam  tomography.  In  x-ray  systems,  the  ver¬ 
tex  point  corresponds  to  the  position  of  a  point  source, 
and  projection  data  are  measured  by  a  sensor  plane 
on  the  opposite  side  of  the  object  from  the  point 
source.  In  the  visible  systems  described  here,  the 
object  is  either  ambiently  illuminated  or  self- 


luminous,  and  the  vertex  point  and  the  sensor  plane 
are  on  the  same  side  of  the  object.  The  basic  geom¬ 
etry  for  our  system  is  illustrated  in  Fig.  1. 

3.  Cone-Beam  Image  Formation 

Having  decided  that  a  camera  gathers  cone-beam 
data,  we  must  consider  how  to  invert  this  data  to 
reconstruct  the  source  density.  A  number  of  cone- 
beam  algorithms  have  been  developed  over  the  past 
two  decades,  and  algorithm  development  continues  to 
be  an  active  area  of  research.  Algorithms  can  be 
classified  according  to  the  nature  of  the  vertex  path 
they  accept  and  the  approach  to  data  inversion. 
Tuy^"^  showed  that  exact  inversion  is  possible  for  ver¬ 
tex  paths  such  that  all  planes  slicing  the  object  vol¬ 
ume  also  intersect  the  vertex  path.  Even  for  paths 
that  technically  satisfy  Tu/s  condition,  inversion 
fidelity  is  limited  in  practice  because  both  the  vertex 
path  and  the  projection  space  are  sampled  discretely. 
In  many  cases,  even  vertex  paths  that  do  not  satisfy 
Tu^s  condition  provide  satisfactory  results.  The 
most  common  inversion  algorithms  use  convolution 
backprojection  methods,  but  a  number  of  alternatives 
to  this  approach  exist.  Continuing  developments 
are  improving  the  computational  efficiency,  vertex 
path  tolerance,  and  sampling  efficiency  of  cone-beam 
systems. 

Our  goal  in  this  paper  is  simply  to  show  how  cone- 
beam  inversion  applies  to  visible  imaging  systems. 
We  do  not  compare  or  analyze  potential  inversion 
algorithms.  Accordingly,  we  chose  to  demonstrate 
imaging  using  the  simplest  and  most  popular  algo¬ 
rithm,  as  developed  by  Feldkamp  et  at.^^  Feld- 
kamp’s  algorithm  is  a  filtered  backprojection 
algorithm  and  can  be  considered  an  extension  of  the 
2-D  fan-beam  reconstruction  algorithm  to  3-D  cone- 
beam  reconstruction.  The  algorithm  uses  the  circu¬ 
lar  vertex  path  illustrated  in  Fig.  1.  As  the  sensor  is 
moved  in  a  circle  around  the  object  space  origin,  it 
rotates  to  point  toward  the  origin.  The  plane  of  the 
vertex  path  is  called  the  midplane.  Feldkamp  also 
considers  the  plane  of  rotation,  which  is  the  plane 
orthogonal  to  the  midplane  and  to  the  ray  from  the 
vertex  point  to  the  origin  containing  the  origin  and 
the  axis  of  rotation.  The  geometry  of  the  midplane 
and  plane  of  rotation  are  illustrated  in  Fig.  4.  Feld¬ 
kamp  parameterizes  each  projection  by  the  vertex 
point  and  by  its  point  of  intersection  with  the  plane  of 
rotation.  As  illustrated  in  Fig.  4,  the  vertex  point  is 
parameterized  by  the  angular  position  on  the  vertex 
path  O.  The  intersection  with  the  plane  of  rotation 
is  also  shown.  Feldkamp  parameterizes  this  point 
with  the  variables  Y  and  Z.  Because  a  camera  mea¬ 
sures  the  projections  parameterized  by  the  angle  sub¬ 
tended  to  the  optical  axis,  we  replace  Y  and  Z  with 

-  Y/d  and  =  Z/d,  Other  than  this  change,  our 
notation  is  identical  to  Feldkamp’s  formulation.  In 
Feldkamp’s  algorithm,  the  angles  of  the  projections 
that  the  sensor  gathers  are  spaced  such  that  the  hor¬ 
izontal  and  vertical  slopes  of  the  projections,  relative 
to  the  sensor’s  rotational  angle  and  position,  are  sam¬ 
pled  at  regular  intervals.  A  paraxial  imaging  sys- 
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Fig.  4.  Illustration  of  coordinate  systems  used  on  midplane  in 
Feldkamp’s  algorithm,  x  and  z  are  the  dimensions  in  the  mid¬ 
plane,  with  X  pointing  at  the  vertex  point  and  z  pointing  along  the 
midplane;  y  points  out  of  the  midplane;  Y  and  Z  are  the  coordinates 
on  the  plane  of  rotation;  d  is  the  radius  of  the  vertex  circle;  (|)  is  the 
angle  from  the  x  axis  to  the  vector  from  the  origin  to  the  vertex 
point;  and  0  is  the  angle  between  the  x  axis  and  the  z  axis. 


tern  has  the  same  regular  spacing,  assuming  the 
image  plane  sensor  is  a  rectilinear  grid  of  pixels. 

Inversion  by  Feldkamp’s  algorithm  consists  of  two 
steps.  First,  the  projection  data  Q  are 

weighted  and  convolved  with  the  separable  filter 
fimctions 


g,iQ  = 


dw|a)|exp(ia)^^.  -  2|(o|/(o^.o), 

‘*>>0 

sin(g,(o^o) 


(6) 


The  bandwidth  parameters  Wyo  and  are  given  by 
the  sampling  period  on  the  camera.  This  produces 
the  intermediate  function 


y  =  I’'  dg/ 1“ 

XP4,(V>^.')(1  + +  (7) 

Finally,  the  source  density  is  estimated  as  the  back- 
projection  of  the  filtered  projection  data  according  to 

DEir) 


1  f 

4Tr^  J  (d  +  r  • 

(8) 


r-y' 


r  ' 


d  r-x'  d  +  r-x' 


d<\>, 


where  d  is  the  radius  of  the  vertex  path  and  the  unit 
vectors  of  the  coordinates  that  rotate  with  the  camera 
are  x\  y\  and  i'.  The  reconstructed  power  density 
Dgir)  is  a  function  of  the  position  r  in  the  source 
space,  and  it  is  an  estimate  of  the  original  power 
density  D{r).  We  modified  the  filtering  function 
from  the  original  Feldkamp  algorithm  by  win¬ 
dowing  it  in  the  frequency  domain  by  an  exponential 
fimction  to  prevent  ringing  at  the  edges. 


4.  Opacity  and  the  Patch  Response 

So  far  we  have  assumed  that  the  source  is  transpar¬ 
ent  and  incoherent.  In  this  case,  a  lens-based  cam¬ 


era  will  measure  cone-beam  linear  projections  of  the 
source,  from  which  we  can  infer  the  power  density  of 
the  source  using  cone-beam  tomographic  algorithms. 
However,  most  sources  at  optical  frequencies  do  not 
satisfy  the  transparent  and  incoherent  assumption. 
Often,  more  realistic  sources  are  opaque,  some  are 
reflecting  rather  than  self-luminous,  and  many  such 
sources  have  rough  surfaces.  A  large  class  of  real¬ 
istic  optical  sources  consists  of  Lambertian  surface 
radiators.  This  class  includes  diffuse  light  sources 
and  rough  surface  objects  illuminated  by  light  having 
low  spatial  coherence.  Unlike  incoherent  sources, 
points  on  the  surfaces  of  Lambertian  sources  do  not 
radiate  isotropically.  Because  of  the  anisotropy  and 
opacity  of  Lambertian  sources,  lens-based  imagers  do 
not  measure  linear  projections  of  such  sources.  If 
one  samples  the  wave  front  from  a  Lambertian  object 
with  a  lens-based  camera  and  uses  these  samples  to 
reconstruct  the  object  using  a  cone-beam  algorithm, 
the  resulting  power-density  reconstruction  is  flawed 
but  is  related  in  a  predictable  way  to  the  actual  sur¬ 
face  radiant  intensity  of  the  source.  Although  the 
power-density  reconstruction  is  not  perfect,  many 
features  of  the  source  are  preserved  and  can  be  found 
by  filtering  the  reconstruction.  By  stud3ring  the  ef¬ 
fect  of  Lambertian  anisotropy  on  the  reconstructed 
power  density,  we  can  account  for  these  effects  in  the 
power-density  reconstruction. 

A  Lambertian  radiating  source  can  be  regarded  as 
consisting  of  infinitesimal  surface  patches,  each  of 
which  radiates  according  to  Lambert’s  law,  which 
states  that  the  radiated  power  at  the  angle  0  from  the 
patch  surface  normal  is  proportional  to  cos  0.  If  the 
Lambertian  source  is  also  convex,  then  no  surface 
patches  are  occluded  from  any  angle,  so  that  each 
patch  is  visible  from  a  hemisphere  of  directions.  Un¬ 
der  these  restrictions,  a  lens-based  camera  will  detect 
an  incident  intensity  that  is  a  linear  function  of  the 
surface  radiant  power  density  of  the  source.  The 
measured  intensity  from  a  given  patch  will  depend 
only  on  the  relative  positions  and  angular  orienta¬ 
tions  of  the  patch  and  camera  and  will  not  depend  on 
occlusion  from  any  parts  of  the  source.  Each  surface 
patch  then  provides  an  individual  contribution  to  the 
cone-beam  reconstruction  that  depends  only  on  its 
position  and  orientation.  We  define  the  contribution 
to  the  reconstruction  from  a  given  infinitesimal  patch 
as  the  patch  response,  which  is  the  3-D  power-density 
reconstruction  of  a  patch  as  the  patch  size  approaches 
zero.  TWs  patch  response  is  a  characteristic  of  the 
Lambertian  radiation  pattern  of  sources,  and  it  is  a 
function  of  both  the  position  and  the  orientation  of 
the  patch.  To  find  the  reconstructed  power  density 
of  a  convex  Lambertian  source,  one  needs  to  integrate 
the  patch  responses  of  all  the  surface  patches,  with 
each  patch  response  appropriately  translated  and  ro¬ 
tated  to  match  the  position  and  orientation  of  each 
patch  and  weighted  according  to  the  power  density  of 
each  patch. 

The  patch  response  is  a  characteristic  blur  function 
attached  to  each  patch  of  the  reconstructed  source. 
To  investigate  this  blur,  we  calculate  the  patch  re- 
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Fig.  5.  Coordinate  system  used  for  the  projection-slice  theorem 
2-D  integral.  21  is  the  length  of  the  Lambertian  line,  r  and  0  are 
the  polar  coordinates  of  the  2-D  density  reconstruction,  and  4>  is  the 
angle  of  the  projections  of  the  Lambertian  line. 


Fig.  6.  Density  plot  of  a  2-D  patch  response  function. 


sponse  for  a  2-D  Lambertian  source.  We  consider  a 
unit  radiant  intensity  thin-line  Lambertian  source  of 
length  21  centered  at  the  origin  and  aligned  horizon¬ 
tally.  The  reconstructed  power  density  of  the  Lam¬ 
bertian  line  source  will  be  that  of  a  finite  extent  line 
patch,  from  which  we  can  determine  the  patch  re¬ 
sponse  by  taking  the  limit  of  the  power  density,  nor- 
mahzed  by  the  length  2Z,  as  the  patch  size  approaches 
zero.  Figure  5  shows  the  line  and  the  coordinates  of 
the  projections  and  the  patch  response.  The  Fourier 
projection-slice  theorem  can  be  used  to  determine  the 
power  density  of  a  2-D  source  from  its  parallel-beam 
projections.  This  derivation  is  detailed  in  Appendix 
A.  The  derivation  consists  of  one  computing  the  re¬ 
sponse  of  a  Lambertian  line  of  length  21  using  the 
Fourier  projection-slice  theorem  and  then  taking  the 
limit  of  this  response  as  the  line  length  approaches 
zero.  The  resulting  patch  response  is 


PRFU,y)  =  A 

4it 


2x 


(^2  +^2)3/2 


log 


{x^  +  ■\- X 


{x^  + 


1/2  . 


(9) 


where  PRF  is  the  patch  response  function  and  x,  y  are 
coordinates  transverse  to  the  patch  surface  normal. 
This  function  is  plotted  in  Fig.  6.  One  may  be 
tempted  to  filter  (correlate)  the  reconstruction  with 
this  patch  response  to  partially  remove  its  effect  on 
surfaces.  However,  because  the  patch  response  is 
oriented  according  to  the  surface  normal  at  each  sur¬ 
face  point,  it  is  actually  a  class  of  functions  that  is 
parameterized  by  a  rotation  angle.  To  deconvolve 
the  patch  response,  the  surface  orientation  must  be 
known  or  estimated.  Fortunately,  the  patch  re¬ 
sponse  still  has  a  local,  confined  nature  so  that  the 
reconstructed  power  density  does  not  stray  too  far 
from  the  original  surface. 

For  nonconvex  objects,  additional  complications 
arise  because  parts  of  the  object  obscure  other  parts. 
Some  patches  will  be  visible  from  a  restricted  (and 
possibly  disjointed)  set  of  angles,  less  than  the  full 
180  deg.  The  power-density  reconstruction  of  a 


patch  will  then  become  dependent  on  the  set  of  angles 
it  is  obscured  from.  Tomographic  reconstruction 
from  a  limited  range  of  angles  is  a  well-studied  prob¬ 
lem.  An  obscured  patch  will  blur  normal  to  the  di¬ 
rections  it  is  obscured  from.  Similarly,  if  projections 
of  the  source  are  gathered  from  a  restricted  range  of 
angles,  the  patch  response  will  become  orientation 
dependent,  and  similar  blurring  will  occur. 

The  reconstruction  of  arbitrarily  shaped  Lamber¬ 
tian  sources  that  have  a  constant  surface  brightness 
is  similar  to  the  reconstruction  of  an  object  from  its 
silhouettes.  The  intensity  a  lens-based  camera 
would  measure  of  a  constant-brightness  Lambertian 
source  in  front  of  a  uniform  dark  background  is  just 
the  inverted  silhouette,  with  the  bright  area  indicat¬ 
ing  the  shadow  of  an  opaque  object  having  the  same 
shape  as  the  source.  If  there  exists  a  convex  Lam¬ 
bertian  source  with  the  same  silhouettes  as  a  non¬ 
convex  source,  then  the  power-density  reconstruction 
of  the  nonconvex  source  will  be  identical  to  that  of  the 
convex  source  because  they  are  indistinguishable 
from  their  projections.  Figure  7  shows  nonconvex 
and  convex  Lambertian  sources  that  have  the  same 
projections  and  therefore  the  same  power-density  re¬ 
construction.  Only  the  extreme  points  on  the  object 
that  bound  the  silhouettes  are  determinable  from  the 
projections,  as  shown  in  Fig.  7,  and  these  points  are 
common  to  all  the  sources  that  share  the  same  sil¬ 
houettes.  The  patch  response  power  density  has  the 
property  of  concentrating  power  density  aroimd  these 
points,  because  the  patch  response  tends  to  cancel 
itself  on  straight  edges  and  accentuate  itself  at  cor- 


Fig.  7.  Three  constant-brightness  Lambertian  objects  that  have 
the  same  silhouettes  and  therefore  the  same  reconstructed  power 
density. 
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Fig.  8.  Density  plot  of  the  patch  response  with  various  sampling  densities. 


ners  when  convolved  with  a  convex  surface.  How¬ 
ever,  if  the  source  has  a  nonconstant  brightness,  the 
power  density  will  resolve  the  nonedge  points. 

So  far,  we  have  considered  only  2-D  Lambertian 
sources  in  the  context  of  the  patch  theory.  3-D 
sources  introduce  an  additional  complication.  In 
3-D  space,  a  four-dimensional  set  of  linear  projections 
can  be  measured  (parameterized,  for  example,  by  po¬ 
sition  on  a  surface  and  direction),  but  normally  only 
a  3-D  subset  of  these  would  be  necessary  for  tomo¬ 
graphic  reconstruction  of  a  nonscattering  source  in  a 
bounded  volume.  In  the  case  of  a  nonscattering 
source,  a  sensor  at  any  vertex  point  measures  projec¬ 
tions  from  the  entire  source  because  occlusion  does 
not  occur,  so  the  set  of  projections  needed  to  recon¬ 
struct  the  volume  is  dependent  only  on  the  shape  of 
the  support  volume  and  not  its  contents.  3-D  Lam¬ 
bertian  sources  can  have  occlusion,  so  the  vertex  path 
of  a  cone-beam  algorithm  must  be  chosen  to  sample 
sufficiently  projections  originating  from  all  surfaces 
of  interest  in  the  source.  Because  the  subset  of  the 
projections  sampled  from  any  given  patch  on  the 
source  is  determined  by  the  vertex  path  of  the  sensor, 
the  patch  response  of  a  given  patch  will  depend  on  the 
vertex  path.  Also  the  reconstruction  can  depend  on 
the  cone-beam  tomographic  algorithm  used  because 
of  differences  in  how  the  algorithms  reconstruct  in¬ 
complete  data  or  handle  the  space-variant  point- 
spread  function  of  the  reconstruction.  Rather  than 
describe  the  general  3-D  patch  response  that  ac- 
coxmts  for  the  vertex  path,  we  confined  the  vertex 
path  for  our  experimental  setup  to  a  plane  containing 
the  source,  but  sufficiently  far  away  from  the  source, 
so  that  the  2-D  patch  response  can  be  used  in  approx¬ 
imation. 

As  suggested  above,  the  power-density  reconstruc¬ 
tion  of  a  Lambertian  source  can  be  filtered  to  enhance 
features  of  the  source  that  are  blurred  because  of  the 
patch  response.  Although  the  patch  response  for 
any  given  patch  depends  on  its  orientation,  so  that  a 
matched  filter  should  match  this  same  orientation,  a 
radially  symmetric  filter  could  match  all  orientations 
imperfectly  and  serve  as  a  useful  compromise.  We 
chose  to  use  a  Laplacian  filter  because  the  {x^  +  y^)”^ 
dependence  of  the  patch  response  suggests  that  a 
Laplacian  filter  might  work  well  to  transform  the 
patch  response  into  a  deltalike  fimction,  as  it  does  for 


5.  Sampling,  Aperture,  and  Resolution 

The  Feldkamp  cone-beam  reconstruction  method  and 
the  patch  response  derived  above  are  for  continuous 
sets  of  projections  and  vertex  paths.  In  real  data 
acquisition,  one  gathers  discretely  sampled  sets  of 
projections  from  a  finite  number  of  points  on  the  ver¬ 
tex  path.  Although  we  do  not  rigorously  consider 
the  effects  of  sampling,  we  present  examples  of  how 
finite  sampling  affects  the  patch  response,  and  we 
give  a  heuristic  argument  that  provides  an  estimate 
of  the  sampling  requirements  needed  to  produce  a 
satisfactory  reconstruction. 

In  optical  cone-beam  tomography,  the  aperture  of 
the  camera  and  the  finite  number  of  pixels  on  the 
camera  determine  the  resolution  of  the  image  recov¬ 
ered.  Each  pixel  corresponds  to  a  cone-beam  projec¬ 
tion  of  the  source,  so  a  denser  pixel  array,  with  a 
correspondingly  larger  aperture,  results  in  a  higher 
density  of  sampled  projections.  A  more  densely 
sampled  set  of  projections  will  improve  the  image 
quality  by  increasing  the  spatial  bandwidth  of  the 
reconstructed  patch,  resulting  in  an  improved  patch 
response.  Figure  8  shows  an  example  of  the  effect  of 
our  sampling  at  various  rates,  where  and  are 
the  spatial  sampling  rates  in  the  y  and  2  directions, 
respectively.  To  achieve  one-pixel  resolution,  one 
must  sample  at  a  resolution  of  one  pixel  per  projec¬ 
tion  at  the  midplane,  which  is  achieved  by  the  sam¬ 
pling  rate  cd^o  =  ^zo  -  Any  higher  rate 

unnecessarily  oversamples  the  patch  response,  and 
lower  rates  do  not  sufficiently  sample  the  patch  re¬ 
sponse  to  achieve  one-pixel  resolution.  Conversely, 
the  sampling  rate  of  the  camera  sets  the  achievable 
bandwidth  and  resolution  of  the  reconstruction.  In 
our  experiments,  we  set  the  resolution  and  field  of 
view  of  the  cameras  to  maximize  the  resolution  while 
maintaining  the  requirement  of  fitting  the  source 
within  the  field  of  view  at  all  vertex  points. 

A  second  consideration  is  the  number  of  vertex 
points  required  to  produce  adequate  resolution  every¬ 
where  in  the  reconstruction  zone.  For  Feldkamp's 
algorithm,  vertex  points  are  equally  spaced  on  a  cir¬ 
cular  path  around  the  reconstruction  volume.  For  a 
128  X  128  pixel  reconstruction  on  the  plane  of  the 
vertex  circle.  Fig.  9  shows  the  quality  of  the  patch 
response  by  use  of  various  numbers  of  projection  an¬ 
gles.  As  the  number  of  projections  approaches  the 
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Fig.  9.  2-D  patch  response  with  various  projection  angles. 


number  of  pixels  in  the  midplane,  the  radial  streak 
artifacts  that  are  due  to  the  sampling  of  the  vertex 
path  disappear.  Denser  sampling  produced  only 
slight  improvement  in  reconstruction  quality,  which 
agrees  with  Ref.  19  for  the  2-D  parallel  beam  case. 
We  set  the  number  of  projections  equal  to  the  number 
of  pixels  across  the  midplane,  or  128  for  our  128  X 
128  reconstruction. 

The  following  examples  provide  two  simple  rules 
that  can  be  used  to  avoid  the  artifacts  shown  here. 
Select  the  imaging  resolution  on  the  camera  as  one 
projection  per  pixel  at  the  midplane,  and  set  the  ver¬ 
tex  path  sampling  density  with  the  number  of  pro¬ 
jections  equal  to  the  number  of  pixels  across  the 
midplane. 

6.  Experimental  Verification 

We  tested  the  idea  of  reconstructing  a  Lambertian 
source  using  a  cone-beam  tomographic  algorithm. 
The  experiment  consisted  of  rotating  an  object,  tak¬ 
ing  an  image  from  each  angle,  and  applying  Feld- 
kamp’s  cone-beam  algorithm  to  estimate  the  power 
density  of  the  source.  The  object  was  a  toy  bear  and 


Toy  on  rotation  stage 


Fig.  10.  Setup  of  cone-beam  data  acquisition. 


was  illuminated  by  a  long  white-hght  fluorescent 
tube  lamp  that  was  approximately  10  cm  from  the  toy 
but  not  Erectly  seen  by  the  camera.  Figure  10  il¬ 
lustrates  the  setup.  The  object  was  placed  on  a  ro¬ 
tation  stage  in  front  of  a  black  absorbing  background, 
which  was  sequentially  rotated  through  360  deg  in 
128  equally  spaced  steps.  At  each  position,  a 
camera-lens  system  and  computer  recorded  an  image 
of  the  object,  which  was  approximately  1  m  away 
from  the  camera.  The  camera-lens  system  consisted 
of  a  50-mm  focal-length  lens  and  a  backilluminated 
16-bit  CCD  focal  plane  array.  To  prevent  nonlin¬ 
earities  in  the  data,  the  focal  plane  used  no  automatic 
gain  control  or  saturation.  The  angular  magnifica¬ 
tion  and  location  of  the  principal  plane  of  the  lens 
were  calibrated  manually.  Each  frame  taken  by  the 
camera  was  512  x  512  in  size.  Only  256  X  256 
pixels  of  the  field  of  view  were  needed,  and  the  data 
were  decimated  to  128  x  128.  The  data  set,  which 
included  the  128  frames  of  the  object  taken  from  dif¬ 
ferent  angles,  the  angular  magnification  of  the  object, 
and  the  distance  from  the  principal  plane  to  the  axis 
of  the  rotation  stage,  was  processed  as  parameters  of 
Feldkamp's  cone-beam  algorithm. 

The  results  of  our  reconstruction  are  shown  in  Fig. 
11.  Figures  11(a)  and  11(b)  show  a  ray-cast  render¬ 
ing  of  the  3-D  power-density  reconstruction  of  the  toy 
bear  from  two  angles.  Because  the  object  can  be 
shown  from  angles  and  positions  where  the  object 
was  not  imaged  originally,  more  information  about 
the  object's  true  shape  can  be  visualized.  Figure 
11(c)  shows  a  cross  section  of  the  reconstructed  power 
density  of  the  head  of  the  bear.  Figure  11  demon¬ 
strates  that  the  surfaces  are  not  sharply  reconstruct¬ 
ed;  some  power  is  effectively  smeared  inside  the  body. 
This  imperfect  reconstruction  is  a  result  of  the  patch 
response  function  contributing  power  into  the  inte¬ 
rior  of  the  reconstruction  of  the  bear’s  head.  The 
power  density  tends  to  be  concentrated  near  the  po¬ 
sition  of  the  original  surface,  so  the  surface  can  be 
still  be  located  within  the  data  set. 

To  reduce  the  power  reconstructed  inside  the 
opaque  object,  we  applied  the  Laplacian  filter  de¬ 
scribed  at  the  end  of  Section  4.  The  new  filtered 
power  density  is  shown  in  Fig.  12.  The  features  on 
the  outer  surface  of  the  bear  are  now  clearer  because 
much  of  the  power  on  the  inside  of  the  object  has  been 
removed.  The  cross  section  of  the  bear’s  head  is 
shown  in  Fig.  12(c)  after  filtering.  Compared  with 
Fig.  11(c),  the  cross  section  is  basically  hollow  except 
for  the  surface.  This  supports  the  idea  that  the  fil¬ 
tered  power  density  will  more  accurately  represent 
the  true  surface.  In  ongoing  research,  we  are  study¬ 
ing  more  sophisticated  methods  for  removing  the  ef¬ 
fect  of  the  nonideal  patch  response.^o 

Appendix  A 

In  this  appendix  we  derive  the  patch  response  given 
in  Eq.  (9).  The  goal  is  to  derive  the  2-D  patch  re¬ 
sponse.  To  do  this,  first  we  derive  a  general  formula 
for  all  2-D  Lambertian  objects.  We  insert  the  pro¬ 
jections  for  a  finite  size  Lambertian  line  object  into 
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(«)  (b)  (c) 

Fig.  11.  Toy  bear  reconstructed  by  Feldkamp’s  algorithm:  (a)  and  (b)  ray-cast  renderings  of  the  side  and  front  views  of  the  power  density 
of  the  bear,  respectively;  (c)  a  lateral  cross  section  through  the  bear’s  head. 


this  formula  and  take  the  limit  as  the  line  length 
approaches  zero.  Finally,  we  integrate  the  projec¬ 
tion  angle  to  calculate  the  response  to  a  infinitesimal 
patch.  To  begin,  we  define  a  2-D  Lambertian  object 
with  a  set  of  extents  /(<})).  The  extent  /(({))  is  defined 
by  the  maximum  value  of  r  cos(0  -  ({))  on  the  object  for 
a  given  angle  cf).  For  a  Lambertian  line  source  with 
extents  Z((j>),  we  define  the  projections  p(Z,  <|))  =  1  for 
-Z((t)  +  tt)  <  Z  <  Z(4))  and  zero  otherwise.  Starting 
from  the  projection-slice  theorem. 


n2ir 

s  exp[Z2Trrs  cos(0  -  -  /js] 

) 

X  P{s,  c|))d4)ds,  (Al) 

where  P(s,  4))  =  0)exp(2TOZ  )dZ.  We  added  an 

extra  parameter  k  ^  0  that  keeps  the  reconstruction 
finite  by  bandlimiting  the  Fourier  transform.  For 
the  Lambertian  source  with  extents  Z((j)),  P{s,  4))  will 
be  the  Fourier  transform  of  the  projections 


p{l,  0)  =  rect{[Z  “  Z(4))/2]/Z(4>)]} 


which  is 


'ns 


sin  TrsZ(4))  ^  ^  sin  ttsZ(4)  +  tt) 

P{s,  4>)  = - exp[-nrsZ(4>)]  +  - 

'ns 

X  exp[Z'7rsZ(4)  +  tt)]. 

We  insert  this  into  Eq.  (Al)  to  obtain 
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We  can  simplify  this  to  obtain 

1*'^  exp[Z2TTrs  cos(0  -  4>)  “ 


fir,  0)  = 


0  V-T, 


I'n 


+  rect{[Z  +  Z(4>  +  'tt)/2]/Z(4)  +  'ir)}, 


X  {1  -  exp[Z2'irsZ(4))]}d4)ds.  (A4) 


i  % 


(a)  (b)  (c) 

Fig.  12.  Laplacian-filtered  reconstructed  bear:  (a)  and  (b)  ray-cast  renderings  of  the  side  and  front  views  of  the  power  density  of  the  bear, 
respectively;  (c)  a  lateral  cross  section  through  the  hear’s  head. 
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The  integration  is  performed  to  become 


To  obtain  the  infinite  bandwidth  patch  response,  we 
find  lim^_^o^(^,  y)- 
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The  left-hand  term  integrates  to  zero,  so  we  can  elim¬ 
inate  it  to  obtain 
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which  is  the  general  formula  for  the  reconstruction  of 
a  general  2-D  Lambertian  object  with  extent  Z((|>). 

To  specialize  this  to  the  case  of  a  finite  size  line,  we 
set  /((}))  =  Z|cos  4)|.  Equation  (A6)  becomes 

N/2 

fir,  0;  Z)  =  {27t^[Z  cos  ^  -  r  cos(0 

J-ti/2 

/*3it/2 

~  4))]-ZTr/j}~M(t)  +  {27r^[-Z  cos  <j> 

J'n/2 

-  r  cos(0  -  (j))]  -  Z7r^}~M4).  (A7) 

We  combine  these  into  a  single  integral.  Further¬ 
more  we  change  to  Cartesian  coordinates  with  the 
transformation  x  =  r  cos  0  and  y  =  r  sin  0: 

fix,y;l)  = 

({ikn  —  27r^[(Z  +  x)cos  (t>  +  y  sin  4)]}“^  \  , 
-{ikn  +  2'Tr^[(Z  +  jc)cos  4>  +  y  sin  4>]}~7 

(A8) 

To  obtain  the  infinitesimal  patch  response,  we  find 
lim^^[^(x,  y;  Z)/2Z],  which  is 
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cos  4)d4). 
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We  perform  the  integration  to  obtain 
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Fig.  3.  Top.  The  angular  notation  used  in  this  paper.  Consider  a  particular  voxel 
and  vertex  point.  We  write  a  for  the  angle  in  the  vertex  plane,  p  for  the  angle 
normal  to  the  vertex  plane,  and  r  for  the  vector  that  connects  the  center  of  the 
vertex  path  to  the  voxel.  Bottom.  Angular  notation,  continued.  For  a  given  image, 
recorded  by  a  camera,  and  refer  to  the  coordinates  on  the  camera.  It  is 
necessary  to  find  a  mapping  function  between  the  camera  coordinates  and 
and  the  points  in  the  reconstructed  voxel  space,  which  are  denoted  by  the  angles  a, 
p,  and  the  vector  r. 


faces  of  the  bubbles. 

As  the  object  rotates  through  N  steps,  an  image  is  taken  at  each  step.  Although  the 
object  is  rotated,  one  may  picture  the  object  as  stationary,  and  the  camera  as  rotating 
about  it  Fig.  2  (bottom).  Each  camera  position  is  referred  to  as  a  vertex  point  where 
(j)  describes  the  angle  of  the  vertex  point  from  the  center  of  the  vertex  path.  The  vertex 
points  are  all  in  a  circle.  The  algorithms  described  here  do  not  require  a  circular  vertex 
path,  but  we  choose  to  use  one  for  experimental  simplicity.  This  circle,  referred  to  as  the 
vertex  path,  lies  on  the  vertex  plane.  The  point  V  is  an  arbitrary  vertex  point,  which 
will  be  referred  to  later.  The  axes  are  defined  such  that  the  x,y,  and  z  axes  travel  with 
the  camera.  The  x  axis  points  towards  the  center  of  the  vertex  path  [8].  The  y  axis  is  in 
the  vertex  plane  but  normal  to  the  vertex  path,  and  the  z  axis  is  normal  to  the  vertex 
plane. 

The  angular  coordinate  notation  used  in  this  paper  is  shown  in  Fig.  3.  Consider  a 
certain  voxel,  and  the  angles  that  it  makes  with  respect  to  a  vertex  point  such  as  V. 
We  refer  to  a  as  the  angle  in  the  vertex  plane,  and  (3  as  the  angle  normal  to  the  vertex 
plane.  The  coordinate  r  connects  the  center  of  the  vertex  path  to  the  voxel.  Note  that 
for  a  given  voxel,  the  values  of  a  and  f3  change,  depending  on  which  vertex  point  we  are 
considering,  but  the  value  of  r  remains  constant. 

For  a  given  image,  recorded  by  a  camera,  and  refer  to  the  coordinates  on  the 
camera.  These  coordinates  are  not  angles,  although  each  value  of  ^  does  correspond 
to  an  angle  projecting  out  from  the  camera.  It  is  necessary  to  find  a  mapping  function 
between  the  camera  coordinates  and  s^nd  the  points  in  the  reconstructed  voxel 
space,  which  are  denoted  by  the  angles  a,  /3,  and  a  distance  coordinate. 

Typical  images  are  shown  in  Fig.  4.  Fig.  4  (left)  shows  an  image  of  a  test  object. 
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•  y 

a  =  arctan  - — — — 
d-\-rmX' 

(4) 

.  i' 

(5) 

B  =  arctan  — — 

d  +  r  .x' 

We  refer  to  Eq.4  and  Eq.5  as  the  mapping  equations,  because  they  define  how  the 
three-dimensional  voxel  space  is  to  be  mapped  into  the  two-dimensional  plane  of  the 
image.  Writing  Eq.3  as  the  tan  of  the  arctan  of  the  angle  in  Eq.4  may  seem  somewhat 
circular,  but  it  is  convenient  to  work  with  the  angle  a 

Eq.3  may  be  evaluated  in  two  ways:  the  voxel  oriented  method  or  the  pixel  oriented 
method.  In  the  voxel  oriented  method,  which  we  use  in  this  paper,  every  voxel  is  con¬ 
sidered.  Then,  for  each  voxel,  we  sum  over  all  pixels.  In  the  pixel  oriented  method, 
the  rays  originating  from  each  pixel  are  projected  through  space,  and  their  intersection 
with  the  voxel  space  is  calculated.  The  difference  between  the  voxel-oriented  method 
and  the  pixel-oriented  method  is  one  of  computational  preference  and  convenience  only, 
and  does  not  appear  in  the  Feldkamp  equations. 

3  Distortion  Compensation 

Our  goal  was  to  image  the  bubbles,  which  have  very  fine  features.  The  bubbles  must 
be  contained  in  a  cylinder,  and  this  cylinder  distorts  the  light  rays.  Using  ray  tracing 
techniques,  we  compensate  for  this  distortion,  and  recover  the  correct  three-dimensional 
reconstruction.  First  we  discuss  the  approach  to  compensating  for  a  generalized  distor¬ 
tion,  and  then  we  discuss  the  specific  case  of  the  plexiglas  cylinder. 

3.1  Distortion  compensation  for  an  arbitrary  refractive  index  profile 

In  Fig.  5,  we  illustrate  the  case  of  a  generalized  (2-D)  distortion.  Assume  that  we  have 
a  known  index  profile  n{x,y)  that  is  completely  contained  within  a  circle  C  with  radius 
Rc>  Outside  this  circle,  the  index  of  refraction  is  n  =  1.0.  In  Fig.  5  (top),  we  show  the 
case  when  n{x,y)  =  1.  Then  we  can  connect  the  vertex  point  V  and  a  voxel  P  with  a 
straight  line,  and  the  equations  described  in  the  previous  section  apply. 

Next  we  consider  the  situation  when  n{x,y)  is  a  known  function,  as  shown  in 
Fig.  5  (bottom).  Here,  the  blue  circle  represents  a  region  where  n{x,y)  is  modified  (e.g. 
n{x,y)  =  2  in  this  region).  We  cannot  compensate  for  this  distortion  by  simply  stretch¬ 
ing  the  image.  The  reason  is  that  distorted  rays  do  not  follow  the  same  path  as  any  of 
the  undistorted  rays.  That  is,  the  rays  in  the  undistorted  space  contain  a  different  set  of 
voxel  points  than  the  rays  in  the  distorted  space.  Therefore,  no  matter  how  the  image  is 
mapped,  these  rays  will  not  coincide.  We  note  that,  for  the  special  case  of  the  cylinder, 
it  may  be  possible  to  correct  the  reconstruction  by  shifting  the  apparent  position  of  the 
vertex  point  and  stretching  the  images,  since  the  cylinder  acts  as  a  lens.  However,  we 
chose  the  approach  described  here  because  it  applies  to  a  more  general  class  of  arbitrary 
distortions  n{x,y),  and  it  is  also  more  exact. 

Under  the  distortion,  the  equations  Eq.l,  Eq.2,  and  Eq.3  will  still  be  valid.  However, 
we  must  change  the  mapping  functions  defined  in  Eq.4  and  Eq.5.  First,  we  will  find  the 
ray  that  connects  P  and  V.  The  point  P'  is  defined  as  the  intersection  of  this  ray  with 
the  circle  C.  The  angle  that  is  necessary  for  the  mapping  functions  (in  Eq.4  and  Eq.5.) 
is  the  angle  between  P'  and  V. 

The  problem  of  connecting  2  points  by  ray-tracing,  given  an  arbitrary  refractive 
index  profile,  is  solved  by  Fermat’s  principle  of  least  time  [12].  To  solve  it  numerically, 
we  require  that  Snell’s  Law  [12]  is  satisfied  at  all  interfaces,  and  that  the  ray  intersects 
P  and  V.  This  inverse  problem  can  be  approached  with  a  simple  searching  algorithm. 
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Fig.  5.  Compensating  for  distortion.  Top.  This  illustrates  the  case  of  a  generalized  (2- 
D)  distortion.  Assume  that  we  have  a  known  index  profile  n{x^  y)  that  is  completely 
contained  within  a  circle  C  with  radius  i?c.  Outside  this  circle,  the  index  of  refraction 
is  n  =  1.0.  Here,  we  show  the  case  when  n(x,  y)  —  1.  Then  we  can  connect  the  vertex 
point  V  and  a  voxel  P  with  a  straight  line,  and  the  equations  described  in  section 
2  apply.  Bottom.  Consider  the  situation  when  n{x,y)  is  a  known  function.  In  this 
case,  the  blue  circle  could  represent  a  region  where  n{x,y)  —  2;  everywhere  else, 
n(x,  y)  =  1.  Using  Snell’s  Law  and  numerical  iteration,  we  find  the  ray  that  connects 
P  to  V.  Starting  at  a  voxel  P,  and  given  a  direction  vector,  we  find  the  intersection 
of  the  ray  with  the  circle  C  at  P'^  Then  the  angles  (for  Eq.4  and  Eq.5)  can  be  found 
from  the  points  M  and  P^ 
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Fig.  6.  This  shows  one  step  in  the  construction  to  find  the  ray  that  connects  the 
voxel  to  the  vertex  point.  Note  that  this  is  a  two-dimensional  calculation.  In  this 
step,  we  project  a  ray  from  the  voxel  towards  the  vertex  point.  Using  Snell’s  law, 
we  find  the  angle  of  refraction  that  occurs  when  the  ray  intersects  the  inner  radius 
of  the  cylinder.  Not  shown  is  the  next  step,  in  which  we  calculate  the  refraction  of 
the  ray  at  the  outer  air-cylinder  interface. 

We  start  from  the  voxel,  P,  and  assume  a  direction  vector.  We  shoot  a  trial  ray  into 
the  volume,  and  measure  the  distance  between  the  ray  and  the  vertex  point  V,  Then 
we  iterate  the  initial  direction  vector  until  the  ray  intersects  the  vertex  point. 

3.2  Distortion  compensation  for  the  specific  case  of  the  plexiglas  cylinder 

The  plexiglas  cylinder  is  easy  to  model  because  it  is  an  exact  circle  in  the  x  —  y  plane. 
Thus,  we  can  solve  for  the  exact  angles,  rather  than  modeling  the  refractive  index  profile 
on  a  grid.  Assume  that  the  cylinder  has  inner  radius  Pi,  outer  radius  R2,  and  index  of 
refraction  n.  Because  the  cylinder  has  no  curvature  in  the  plane  normal  to  the  vertex 
plane,  Eq.5  remains  unchanged.  Eq.4  must  be  changed  because  the  distortion  will  alter 
the  angle  a.  This  is  now  a  two-dimensional  problem. 

Fig.  6  is  a  diagram  in  which  we  show  one  step  in  the  construction  used  to  solve  for 
the  ray  path.  This  diagram  represents  the  general  case  in  which  we  have  a  voxel  with 
position  inside  a  circle,  and  a  direction  vector.  We  wish  to  find  the  point  N'  at  which 
this  ray  will  intersect  the  circle,  as  well  as  the  output  direction  vector.  The  point  N'  is 
found  by  following  the  initial  direction  vector  until  the  circle  is  intersected.  The  radius 
connecting  iV'  with  the  center  of  the  circle  C  makes  a  90°  angle  with  the  tangent  to  the 
circle.  Thus,  we  can  find  the  angle  7,  and  then  using  Snell’s  Law,  find  the  angle  x- 
this  case  we  take  the  inner  index  of  refraction  as  ui  and  the  outer  index  of  refraction  as 
712-  Note  that  we  are  considering  a  cylinder  with  a  given  thickness,  so  that  we  will  repeat 
this  calculation  twice.  The  first  time,  we  will  assume  that  the  cylinder  has  ui  =  1,0  (air) 
inside,  and  n2  =  1.49  (plexiglas)  outside.  The  second  time,  after  finding  the  point  N\ 
we  will  then  assume  that  the  cylinder  has  plexiglas  inside  and  air  outside.  The  point  at 
which  this  ray  intersects  the  x-axis  is  then  found. 

In  Fig.  7,  we  show  a  ray  tracing  diagram  with  several  rays  plotted.  This  represents 
the  result  of  the  calculation  described  above,  as  well  as  the  searching  algorithm  to  find 
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Fig.  7.  Solving  for  the  rays  such  that  they  intersect  the  vertex  point.  Top.  Magnified 
view  of  cylinder.  Bottom.  This  image  shows  the  cylinder  as  well  as  the  vertex  point. 


Fig.  8.  Left.  Reconstructing  the  test  object  of  the  needles  without  applying  the 
distortion  algorithm.  This  three-dimensional  image  was  generated  by  vtk[10].  The 
colors  in  this  picture  are  an  arbitrary  color  map  and  have  no  significance.  Right  The 
image  is  improved  through  application  of  the  distortion  algorithm.  The  red  area  in 
the  back  of  this  image  is  a  piece  of  paper  that  was  in  the  original  object. 

the  correct  direction  vector  that  will  intersect  the  vertex  point. 

4  Results  and  Analysis 

In  Fig.  8  (left)^  we  show  the  three-dimensional  reconstruction  of  the  test  object  from 
Fig.  4  (left).  This  reconstruction  is  done  without  correcting  for  the  distortion.  It  can 
be  seen  that  the  features  are  somewhat  blurry.  Fig.  8  (right)  shows  the  substantial 
improvement  when  the  correction  algorithm  is  applied.  Fig.  9  (left)  is  a  slice  of  the 
dataset  (without  distortion  correction)  that  is  normal  to  the  z  axis,  and  Fig.  9  (right) 
is  a  similar  slice  of  the  dataset  (with  distortion  correction).  The  distortion  will  be  more 
significant  for  points  that  are  closer  to  the  edge  of  the  cylinder.  As  shown  in  Fig.  7,  the 
rays  from  such  edge  points  are  modified  more  than  points  that  are  closer  to  the  center. 
This  effect  can  be  seen  in  Fig.  9  (left),  where  points  farther  away  from  the  center  appear 
as  blurred  crosses,  but  points  closer  to  the  center  of  the  cylinder  appear  as  sharper 
points. 

We  then  applied  this  algorithm  to  the  case  of  the  bubbles,  using  the  input  data  shown 
in  Fig.  4  (right).  Fig.  10  (feyi;uncorrected  and  n^fti;corrected)  shows  the  result  with 
and  without  the  distortion  correction  algorithm.  Clearly,  after  applying  the  correction 
algorithm,  the  image  is  substantially  improved.  Slices  of  the  bubble  dataset  are  shown 
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Fig.  11.  Top. This  is  a  slice  through  the  dataset  of  Fig.  10,  which  is  a  reconstruction 
of  the  bubbles  without  applying  the  distortion  correction.  There  is  some  blurring  in 
this  image.  Bottom  Left.  The  distortion  correction  algorithm  is  applied,  improving 
the  bubbles  images.  Bottom  Right.  An  erosion  algorithm  is  applied  to  reduce  each 
blob  in  the  image  at  left  (the  corrected  bubbles  images)  to  a  single  point. 
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Fig.  9.  Left.This  is  a  slice  through  the  dataset  of  Fig.  8,  which  is  a  reconstruction 
of  the  needles  test  object  without  applying  the  distortion  correction.  The  needles, 
which  should  appear  as  points,  in  this  case  appear  as  blobs.  Some  of  the  features 
appear  as  crosses.  Right.  The  distortion  correction  algorithm  is  applied.  The  cross 
section  of  the  needles  now  appear  as  points. 


Fig.  10.  Left.  Reconstructing  the  bubbles  without  applying  the  distortion  algorithm. 
Only  a  slice  of  the  image  from  Fig.  4  is  reconstructed.  Right.  The  image  is  improved 
through  application  of  the  distortion  algorithm. 
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in  Fig.  11  (fojo: uncorrected  and  bottom  fe/t;corrected).As  in  the  example  of  the  needles, 
the  closer  the  points  are  to  the  center  of  the  cylinder  (in  the  uncorrected  image),  the 
less  they  are  distorted.  For  studying  the  foam,  it  will  be  important  to  have  a  complete 
set  of  data  that  includes  the  points  closest  to  the  cylinder  edge,  so  that  this  correction  is 
necessary.  The  improvement  with  this  correction  algorithm  seems  quite  clear,  although 
the  corrected  image  still  shows  some  blurring  for  points  close  to  the  edge  of  the  cylinder. 
The  image  may  be  further  improved  with  image  processing.  In  Fig.  11  {bottom  right) ^ 
we  show  an  erosion  [13]  algorithm  applied  to  the  data  of  Fig.  11  {bottom  left). 

5  Conclusions 

In  this  paper  we  show  reconstruction  of  a  three-dimensional  foam.  The  foam  is  re¬ 
constructed  using  tomography  algorithms.  Using  an  algorithm  that  incorporates  ray 
tracing,  we  are  able  to  compensate  for  the  distortion  induced  by  a  plexiglas  cylinder.  It 
is  shown  that  this  algorithm  improves  the  images  for  the  case  of  a  test  object,  as  well 
as  for  the  bubbles.  This  distortion  correction  algorithm  may  be  useful  in  various  areas 
of  tomography. 

One  area  of  future  work  will  include  improving  the  initial  images.  This  could  include 
redesign  of  the  container,  with  thinner  walls,  to  reduce  or  eliminate  the  distortion  prob¬ 
lem.  Although  this  would  improve  our  foam  imaging,  it  is  noted  that  part  of  our  goal 
was  to  study  the  computational  correction  of  optical  distortion.  The  illumination  of  the 
Plateau  borders  could  also  be  improved.  In  [14],  the  authors  dissolve  fluorescein  salt  in 
their  foaming  solution  and  illuminate  with  ultra-violet  light.  With  this  technique,  the 
Plateau  borders  fluoresce  and  there  is  no  stray  light. 

We  are  currently  analyzing  the  3-dimensional  data  set  to  reveal  the  exact  polyhedral 
configuration  and  its  evolution.  This  work  includes  signal  processing  techniques  such  as 
matched  filtering. 

We  thank  the  reviewers  for  helpful  comments.  E.  Tan,  S.T.  Thoroddsen,  and  J.M. 
Sullivan  are  supported  by  NASA  Grant  NAG3-2122  under  the  Microgravity  Fluid 
Physics  Program. 
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resolution  of  three-dimensional  objects  reconstructed  by  extended  depth-of-field  tomography.  Our  algorithm 
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Inversion  of  the  line  integrals  associated  with  extended 
depth-of-field  (EDF)  imaging  has  been  used  in  the 
x-ray  regime  to  reconstruct  three-dimensional  (3D) 
objects.^"^  Related  ray-projection  techniques  have 
been  used  in  the  visible  range  to  reconstruct  radiant 
sources/  In  Ref.  5  we  used  EDF  pinhole  imaging 
to  reconstruct  a  3D  volume  in  the  visible  spectral 
range.  The  relatively  poor  transverse  resolution  of 
the  pinhole  camera  is  a  shortcoming  for  this  technique. 
The  cubic-phase  plate  (CPP)  EDF  system®"®  measures 
similar  line  integrals  while  maintaining  a  relatively 
large  system  aperture.  The  larger  aperture  yields 
superior  transverse  resolution  and  light-gathering 
efficiency.  In  this  Letter  we  describe  the  use  of  a  CPP 
EDF  system  to  form  3D  images. 

Aperture  modulation  in  CPP  imaging  yields  a  point 
spread  function  (PSF)  that  is  relatively  insensitive 
to  defocus.  Digital  deconvolution  of  the  PSF  3delds 
an  image  focused  at  all  depths  for  which  the  range 
invariance  holds.  The  transmittance  of  a  CPP  is 
t{Xyy)  =  exp[ja{x^  +  y^)].®  Assuming  an  unbounded 
aperture  is  the  Airy  Ai  function,  and  y  is  the  defocus 
parameter  (1/z  +  1/z'  —  1/f),  the  PSF  for  quasi- 
monochromatic  imaging  between  a  source  point  at 
{x,yyz)  and  an  image  point  at  (x^y^z^)  can  be  shown 
to  be 


where  Ai{x)  is  the  Airy  Ai  function^®  and  f  is  the  fo¬ 
cal  length.  To  form  a  range-independent  deblurred 
image,  we  deconvolve  the  PSF  from  the  detected 
image.  The  deblurred  image  is  sheared  with  re¬ 
spect  to  range,  but  the  shear  can  be  removed  in 
3D  imaging.  In  practice,  the  finite  plate  aperture 
limits  the  range  independence  of  the  PSF.  The  in- 
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finite  aperture  approximation  assumes  that  the 
cubic  phase  varies  more  rapidly  than  the  natu¬ 
ral  quadratic  phase  at  the  aperture  edge.  This  cri¬ 
terion  implies  that  y  must  be  comparable  with  ad  A, 
where  d  is  the  system  aperture. 

We  consider  the  CPP  EDF  camera  imaging  source 
volume  in  Fig.  1.  The  camera  acquires  a  series  of 
images  as  it  is  translated  laterally  to  the  optical 
axis.  The  lateral  position  of  the  center  of  the  camera 
principal  plane  is  denoted  x.  Unlike  in  Ref.  5,  the 
camera  axis  rotates  about  a  point  in  the  source  space 
during  lateral  displacement.  The  rotation  centers  the 
reconstructed  range  field  on  the  pivot  point.  The 
nominal  distance  from  the  pivot  point  to  the  center 
of  the  camera  aperture  is  zq.  We  form  3D  images  by 
capturing  a  series  of  distorted  2D  images  for  various 
values  of  x,  digitally  deconvolving  each  frame  to  obtain 
an  in-focus  EDF  2D  image  and  transforming  the  series 
of  EDF  images  to  obtain  a  3D  source  model. 

Assuming  that  the  pivot  point  satisfies  the  imaging 
condition,  zq  =  z'f  fz'  -  fy  and  defining  txz  =  z  —  zo, 
the  origin  of  the  PSF  in  the  (x',  y')  plane  for  the  source 
point  at  (jc,y,z)  is 


TT  1 

6aAzo^  ' 

^  z  ) 

1 

rAzf 

^  2  / 

objeci  volume 


Fig.  1.  System  geometry. 
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For  a  given  value  of  x  the  deconvolved  image  is 
approximated  by 


HLv)  =  j  P{x,y,z)8  ^ 
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(x  +  x)zo  ^  ^ 
Z  Zo 


TT 


6aXzo^ 

TT 

6aAzo^ 


('  -  f  )1#  -  f 

jdxdydz,  (2) 


where  P{x,y,  z)  is  the  source  power  density.  Inverting 
Eq.  (2)  as  in  Ref.  5,  we  Fourier  transform  with  respect 
to  (^,  77)  and  introduce  the  variables  Xp  =  {z^ lz)x,  yp  = 
{z^ lz)y,  q  =  k^z^x^  and  Zp  =  I/2  to  obtain 

l{kf,kr,,q)=  f  P{Xp,yp,Zp)exp{jkfXp)exp{jkr,yp) 


X  expijqzp)exp{-jqzop)exp 
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Fourier  inversion  of  Eq.  (3)  5delds  the  focused  3D  source 
distribution  evaluated  at 
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where  {xp,yp,Zp)  are  the  Fourier  conjugate  variables 
for  (k^ykrfyq)-  The  range  in  {k^^kn^q)  over  which 
l{k^,  krj,q)  can  be  sampled  defines  the  3D  bandpass,  or 
band  volume,  for  the  imaging  system.  The  3D  Fourier 
transform  of  the  band  volume  is  the  system  impulse 
response.  Since  the  longitudinal  Fourier  sampling 
coordinate,  q,  is  proportional  to  the  transverse 
sampling  coordinate,  there  is  a  missing  cone  in 
the  band  volume.  “  The  longitudinal  resolution  for 
low-transverse-frequency  objects  is  limited  as  a  result 
of  the  missing  cone. 

We  confirmed  our  model  for  3D  imaging  by  experi¬ 
mentally  measuring  the  impulse  response.  Our  ex¬ 
perimental  system  consisted  of  two  20-cm  focal-length 
lenses  (3delding  a  nearly  10-cm  effective  focal  length) 
separated  by  a  1.2-cm-aperture  CPP  pupil  with  a  == 
58.6  cm"^.  We  placed  the  sources  and  the  focal-plane 
array  approximately  20-cm  from  the  CPP  to  achieve 
nominal  1:1  imaging.  The  focal-plane  array  was  a  512 
by  512,  1.27-cm-square  Princeton  Instruments  back- 
illuminated  16-bit-resolution  CCD  camera.  The  cam¬ 
era  and  the  imaging  system  were  attached  to  metal 
rods  and  placed  on  a  computer-controlled  Newport 
rotation  stage,  which  was  attached  to  an  Aerotech 
computer-controlled  translation  stage  with  5-cm  travel. 

A  660-nm  laser  diode  that  operated  as  a  LED  served 
as  the  point  source  for  building  the  digital  deconvo¬ 


lution  filter.  We  placed  the  source  20  cm  from  the 
cubic-phase  mask  and  sensed  the  raw  PSF  at  the  focal 
plane.  Because  the  cubic-phase  transmittance  is  rect¬ 
angularly  separable,  we  sampled  the  PSF  on  the  x  and 
y  axes  and  computed  an  inverse  weighted  Wiener  fil¬ 
ter  of  the  sampled  data  to  obtain  separate  vertical  and 
horizontal  deconvolution  filters.  We  selected  the  filter 
weight  to  band  limit  the  inverse  filter  to  prevent  noise 
from  dominating  the  image.  We  used  ^50%  of  the 
bandwidth  of  the  system.  The  digitally  deconvolved 
PSF  occupied  from  1.5  to  2  camera  pixels,  and  the  raw 
PSF  covered  approximately  15  pixels.  The  CCD  cam¬ 
era’s  pixels  were  22  fxm.  square. 

We  acquired  frames  by  translating  the  imaging 
system  at  fixed  intervals.  At  each  acquisition  position 
we  rotated  the  camera  toward  the  source  pivot  point 
and  integrated  the  intensity  on  the  focal  plane  for 
30  ms.  The  total  length  of  travel  of  the  translation 
stage  was  4.5  cm,  and  the  total  rotation  angle  was 
—13*’.  256  images  were  taken  over  this  path.  The 
projections  were  sampled  at  512  by  512  pixels  and 
deconvolved.  After  deconvolution,  we  resampled  the 
projections  to  compensate  for  the  camera  rotation  and 
to  compress  the  frame  size  to  256  by  256.  The  re¬ 
sampled  images  corresponded  to  projections  displaced 
linearly  in  the  tangents  of  the  angles  as  measured  from 
each  projection  origin.  We  combined  the  projections 
into  a  3D  model  of  the  source  by  computing  the  2D 
Fourier  transform  of  each  image,  resampling  the 
axis  onto  a  Cartesian  grid,  and  then  taking  the  3D 
Fourier  transform.  These  operations  were  performed 
in  0{N^  log  N)  time. 

We  tested  our  system  by  reconstructing  the  660-nm 
point  source  at  approximate  distances  of  15, 17, 20,  and 
25  cm  from  the  principal  plane  of  the  imaging  system. 
Figure  2  shows  transverse  slices  through  each  of  the 
reconstructed  3D  PSF’s.  The  axes  correspond  to 
projection  angle.  Each  axis  spans  52  mrad.  The 
15-cm  image  is  significantly  worse  because  the  sharp 
increase  in  defocus  as  one  approaches  the  principal 
plane  causes  the  invariant  raw  PSF  approximation  to 
fail.  Longitudinal  slices  through  the  reconstructed 
3D  PSF’s  are  shown  in  Fig.  3,  The  horizontal  axis 
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Fig.  2.  Superimposed  lateral  cross  sections  of  four  digi¬ 
tally  reconstructed  3D  PSF’s,  labeled  with  their  distances 
from  the  principal  plane.  The  axes  are  angles  labeled  in 
milliradians. 
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Fig.  3.  Superimposed  longitudinal  cross  sections  of  four 
digitally  reconstructed  3D  PSF's  labeled  with  their  dis¬ 
tances  from  the  principal  plane.  The  horizontal  axis  is 
angle  labeled  in  milliradians,  and  the  vertical  axis  is  pro¬ 
jective  depth  labeled  in  centimeters.  The  vertical  scale  is 
plotted  linearly  in  1/z  space  but  is  marked  in  z  space. 


for  our  system.  The  pinhole  size  needed  to  achieve 
this  depth  of  field  at  660  nm  is  800  yum.  The  trans¬ 
verse  resolution  for  the  pinhole  system  would  be 
approximately  one  order  of  magnitude  worse  than  the 
80“  100- yum  resolution  indicated  for  the  cubic-phase 
system  in  Fig.  2. 

Figure  4  demonstrates  3D  reconstruction  of  a  com¬ 
plex  source.  The  source  consisted  of  white-on-black 
text  and  images  on  small  strips  of  paper.  The  pa¬ 
pers  were  illuminated  by  two  broadband  fluorescent 
lamps  to  provide  uniform  illumination.  The  paper  in 
the  front  had  the  letters  ARL  on  it,  the  paper  in  the 
middle  had  a  stick  figure  likeness  of  a  man,  and  the 
paper  in  the  rear  had  the  letters  UIUC  on  it.  The  ex¬ 
posed  sections  of  the  papers  were  approximately  0.3 
by  0.4  cm  in  size.  Figure  4  shows  three  cross  sections 
of  the  source  at  various  depths.  The  intensity  of  the 
source  is  shown  in  reverse,  and  the  negative  intensity 
artifacts  that  are  due  to  the  PSF  have  been  filtered  out. 
Although  the  reconstruction  is  fairly  accurate  on  these 
planes,  it  should  be  noted  that  the  PSF  spreads  the  im¬ 
ages  over  many  planes,  as  can  be  seen  because  the  stick 
figure  man  in  the  center  plane  appears  weakly  in  the 
other  two  planes. 

The  cubic-phase  plate  extended  depth-of-field  sys¬ 
tem  jdelds  substantially  better  transverse  resolution 
than  a  pinhole  with  comparable  depth  of  field.  Since 
the  transverse  resolution  is  coupled  to  longitudinal 
resolution  through  the  q  variable,  increased  trans¬ 
verse  resolution  translates  directly  into  improved  lon¬ 
gitudinal  resolution  for  a  given  scan  range.  Further 
investigation  into  the  optimality  of  the  cubic-phase 
modulation,  the  effect  of  noise  in  deconvolution,  and 
deconvolution  filter  design  is  required  for  characteri¬ 
zation  and  exploitation  of  this  improvement  in  longitu¬ 
dinal  resolution. 


Fig.  4.  Three  lateral  slices  through  the  reconstruction  of 
a  demonstration  source.  The  axes  correspond  to  angular 
position  relative  to  the  principal  axis  in  milliradians. 

represents  the  transverse  resolution  in  milliradians, 
and  the  vertical  axis  represents  the  projective  depth 
in  inverse  meters.  The  vertical  axis  spans  1.16  m”^ 
The  projective  depth  is  the  depth  that  is  linear  in 
z~^  and  not  in  z.  The  vertical  axes  are  marked  in  z 
coordinates,  however.  Three  separate  axes  are  shown 
because  the  reconstructed  sources  are  aliased  onto 
the  plot  from  three  separate  reconstruction  patches. 
The  reconstruction  uses  a  projective  depth  step  size 
of  0.0045  m“\  which  is  determined  by  the  total 
linear  length  of  travel  of  the  camera  (icspan  =  4.5  cm) 
and  the  angular  resolution  of  the  camera 
(^res  =  0.2  mrad)  by  Zres  =  ^res/^span-  The  achieved 
resolution  is  limited  by  incomplete  coverage  of  the  3D 
Fourier  space  and  the  band  limit  in  the  deconvolution 
kernel.  The  measured  longitudinal  sizes  of  the  source 
are  0.216  m"^  (4.9  mm)  for  the  15-cm  trial,  0.153  m”^ 
(4.4  mm)  for  the  17-cm  trial,  0.122  m“^  (4.8  mm)  for 
the  20-cm  trial,  and  0.189  m"^  (11.8  mm)  for  the  25-cm 
trial.  As  indicated  by  the  17-  and  the  25-cm  recon¬ 
structions,  the  depth-of-field  exceeds  1  m"^  This 
range  is  consistent  with  the  value  of  adX  =  0.46  m“^ 
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We  describe  a  modified  confocal  microscope  in  which  depth  discrimination  results  from  matched  filtering  by 
a  volume  hologram  instead  of  a  pinhole  filter.  The  depth  resolution  depends  on  the  numerical  aperture 
of  the  objective  lens  and  the  thickness  of  the  hologram,  and  the  dynamic  range  is  determined  by  the 
diffraction  efficiency.  We  calculate  the  depth  response  of  the  volume  holographic  confocal  microscope,  verify 
it  experimentally,  and  present  the  scanned  image  of  a  silicon  wafer  with  microfabricated  surface  structures. 
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The  pinhole  preceding  the  detector  in  a  confocal  mi¬ 
croscope  is  a  shift-variant  optical  element.  On-axis 
in-focus  point-source  objects  are  imaged  exactly  inside 
the  pinhole  and  give  maximal  intensity.  An  out-of- 
focus  object,  even  when  it  is  on  axis,  is  equivalent 
to  an  extended  source  on  the  input  focal  plane.  The 
off-axis  portion  of  this  extended  source  is  filtered  out 
by  the  limited  aperture  of  the  pinhole.  Theoretically, 
the  depth  resolution  is  optimal  when  an  infinitesi¬ 
mally  small  pinhole  is  used.^  However,  such  a  device 
is  an  ad  hoc  filter  that  does  not  match  perfectly  the 
impulse  response  of  any  realistic  optical  system.  In 
practice,  the  minimum  pinhole  size,  and  hence  the 
depth-resolution  limit,  are  determined  by  light  effi¬ 
ciency  (i.e.,  the  required  dynamic  range  of  the  mea¬ 
surement)  and  the  broadening  of  the  focal  spot  by  lens 
aberrations.^  Coupling  the  dependence  of  two  func¬ 
tional  requirements  (depth  resolution  and  dynamic 
range)  to  a  single  design  parameter  (the  pinhole  size) 
is  a  poor  design  choice.^  This  is  evident  when  the  col¬ 
lected  light  has  low  intensity,  e.g.,  in  fluorescence  and 
two-photon  confocal  microscopy. 

In  this  Letter  we  present  a  new  confocal  imaging 
principle  in  which  the  pinhole  is  replaced  with  a 
matched  filter  recorded  on  a  volume  hologram.  The 
hologram  is  recorded  such  that  the  field  that  is  gen¬ 
erated  by  an  in-focus  object  is  maximally  diffracted, 
whereas  objects  that  are  out  of  focus  are  filtered  out 
because  they  are  Bragg  mismatched.  Consequently, 
dynamic  range  and  axial  resolution  are  decoupled;  the 
dynamic  range  is  determined  by  the  diffraction  effi¬ 
ciency  of  the  volume  hologram,  and  the  axial  resolution 
by  the  numerical  aperture  of  the  objective  lens  and 
the  thickness  of  the  hologram.  Additional  benefits  of 
pinhole-free  confocal  microscopy  are  ease  of  alignment 
and  improved  aberration  performance:  Objective- 
lens  aberrations  are  phase  conjugated  out  during  the 
hologram  reconstruction  process,  and  collector-lens 
aberrations  (which  increase  the  collected  spot  size)  are 
irrelevant  in  the  absence  of  a  pinhole. 

The  volume  holographic  confocal  microscope  is 
shown  schematically  in  Fig.  1.  The  volume  hologram 
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is  recorded  by  the  interference  of  two  coherent  beams 
at  wavelength  A.  The  objective  lens  brings  the  first 
beam  to  focus  on  a  reference  surface,  one  focal  distance 
F  away  from  the  objective.  The  reflected  beam  is 
recollimated  by  the  same  objective  and  is  used  as 
the  recording  plane-wave  reference  beam,  with  wave 
vector  k/?  =  (27r/A)i.  The  signal  beam  is  a  plane 
wave  that  is  incident  upon  the  recording  medium  along 
ks  =  (27r/A)x  (90°  recording  geometry).  The  resulting 
grating  vector  is  K  =  ks  -  Ilr.  During  the  imag¬ 
ing  operation,  the  signal  beam  is  blocked.  The  ref¬ 
erence  surface  is  replaced  by  the  object  surface,  and 
the  reflected  beam  reconstructs  the  volume  hologram. 
The  diffracted  light  is  collected  by  a  second  objective 
lens  (focal  length  FO  and  captured  by  a  photodetector. 

Compared  with  a  reflection-mode  confocal  micro¬ 
scope,  the  imaging  arrangement  shown  in  Fig.  1  con¬ 
tains  two  modifications,  in  addition  to  the  volume 
hologram:  (a)  the  objective  lens  is  placed  in  a  Fourier- 
transform  rather  than  an  imaging  configuration  and 
(b)  the  aperture  in  front  of  the  detector  does  not 
contribute  to  depth  discrimination  but  only  limits  scat¬ 
ter  and  other  light-noise  sources.  If  the  reconstruct¬ 
ing  object  is  in  focus  (dotted  lines  in  Fig.  1),  this  device 


Fig.  1.  Volume  holographic  confocal  microscope  without  a 
pinhole  at  the  detector  plane. 
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operates  exactly  like  a  confocal  microscope,  because 
the  volume  hologram  is  Bragg  matched  (the  recording 
and  the  reconstructing  reference  beams  are  identical); 
therefore  the  diffracted  intensity  reaching  the  detector 
is  maximum. 

Consider  now  an  object  that  is  defocused  by  a 
small  distance  d.  The  beam  that  is  reflected  from 
the  object  is  no  longer  collimated  by  the  objective 
lens  but  contains  an  angular  spectrum  of  plane-wave 
componencs,  as  shown  by  the  solid  lines  in  Fig.  1. 
Diffraction  of  the  off-axis  components  by  the  volume 
hologram  is  weaker  because  of  Bragg  mis¬ 
match.  Consider  the  component  with  wave  vector 
kp  =  {27r/A){ux  “  i;y  +  [1  “  {u^  +  v^)/i\z],  shown  in 
Fig.  2  (\ul  \v\  «  1).  Born’s  first  approximation  in 
volume  diffraction  theory"^  requires  that  the  diffracted 
wave  vector  have  the  same  y  and  z  and  compo¬ 
nents  as  the  vector  k'  =  kp  -I-  K  and,  moreover,  that 
|kdl  =  27r/A;  therefore 


fracted  intensity  decreases  rapidly  as  a  result.  The 
instrument  is  optimal  if  all  the  light  coming  out  of 
the  objective  reaches  the  hologram,  i.e.,  L  =  A. 

The  Bragg-mismatch  effect  (expressed  through  the 
sine  function  in  the  integrand)  effectively  acts  as  a 
matched  spatial  filter,  discarding  the  defocused  light. 
This  shift-variant  filtering  operation  is  similar  to  the 
field-of-view  limitation  imposed,  by  the  pinhole  of  a 
confocal  microscope.  The  passband  has  an  elliptical 
shape,  with  semiaxes  Umax  =  A/L  and  Umax  =  V^A/L. 
Since  Umax  »  Umax,  the  depth  response  is  determined 
primarily  by  the  term  (NA)^|5|/?  in  the  argument  of 
the  sine  function  of  Eq.  (3).  As  a  measxire  of  depth 
resolution,  we  use  the  FWHM  of  7){S),  By  fitting 
numerical  data  from  Eq.  (3)  at  the  optimal  geometry 
L  =  A,  we  obtain 

5fwhm  =  1-09  X  ^  \  •  (4) 


kd  = 


.1 

"J- 


(1) 


Taking  only  one  diffracted  component,  k^,  into  account 
in  effect  neglects  the  finite  extent  of  the  hologram 
in  the  y  and  z  dimensions.  However,  the  analysis 
remains  valid  because  the  entire  spatial  spectrum 
that  is  diffracted  in  response  to  kp  behaves  (in  the 
paraxial  approximation)  similarly  to  its  central  plane- 
wave  component  k^,  which  is  the  only  component 
that  we  consider  here.  In  other  words,  the  impulse 
response  that  is  due  to  the  finite  hologram  aperture 
does  not  affect  the  depth  discrimination  of  the  system. 

The  diffracted  intensity  along  this  central  component 
krf  is  proportional  to  sinc^(A/e^L/277),  where  L  is  the 
extent  of  the  hologram  in  the  x  direction,  and  sinc(f )  = 
sin(7r^)/(7r^).  The  quantity  is  the  deviation  of  k' 
from  the  k  sphere  (see  Fig.  2): 


=  |k'  -  kdl  =  ^  ^ j •  (2) 

To  obtain  the  overall  diffraction  efficiency  summed 
over  an  infinite  detector  area  we  integrate  the  dif¬ 
fracted  intensities  from  all  spatial  frequency  compo¬ 
nents  kp  that  are  allowed  through  the  circular  objective 
aperture  (diameter  A;  Fig.  1)  and  normalize  them  for  a 
total  incident  power  of  1.  The  result  is 

f  dpp  sinc^|(NA)2|5lp  ^ 

'TT  Jo  Jo  I  A  A 

X  j^cos  0  +  (NA)2|S|p  (3) 

where  770  —  17(0),  (NA)  *=  A/(2F)  is  the  objective 
numerical  aperture,  \d\/F  «  1  is  assumed,  and  polar 
coordinates  {p,  0)  are  substituted  for  (u,  u)  in  the  in¬ 
tegral.  A  microscope  without  a  pinhole  in  front  of  the 
detector  corresponds  to  the  case  L  =  0,  when  the  to¬ 
tal  detected  intensity  does  not  depend  on  object  depth. 
For  finite  thickness  L  >  0,  the  integral  increases  with 
\8\  much  slower  than  the  denominator  8^,  and  the  dif¬ 


By  comparison,  a  confocal  microscope  with  zero  pinhole 
size  has  5fwhm  =  0.86  X  A/(NA)^,  but  the  FWHM  in¬ 
creases  rapidly  with  pinhole  size  in  realistic  systems.^ 

We  implemented  the  pinhole-free  confocal  micro¬ 
scope  shown  in  Fig.  1  experimentally.  We  used  an 
Ar"^  laser  (A  =  488  nm)  as  a  light  source;  a  1-cm^ 
LiNbOs’Fe  crystal  (45®  cut;  refractive  index,  ^2.2)  as 
a  holographic  medium;  a  60x,  NA  0.85  objective  lens 
(A  «  5  mm);  and  a  lOX,  NA  0.25  collector  lens.  The 
reference  and  the  object  surfaces  were  polished  silicon 
wafers  with  microfabricated  features,  mounted  upon  a 
Klinger  translation  stage  (0.1-/£m  step  size)  with  three 
degrees  of  freedom.  The  light  collected  through  a  vari¬ 
able  aperture  was  measured  with  a  UDT  photodetector. 
To  implement  a  confocal  microscope  in  the  same  experi¬ 
mental  arrangement  we  simply  replaced  the  volume 
hologram  with  a  mirror  oriented  at  45®,  directing  the 
reflected  beam  into  the  collector  lens. 

The  dependence  of  the  normalized  diffraction  effi¬ 
ciency  on  the  depth  of  the  object  surface  is  shown  by 
curves  (a)  and  (b)  of  Fig.  3.  The  depth  resolution  is 
the  same  for  aperture  sizes  of  25  pm  (matched  to  the 


Fig.  2.  Bragg  mismatch  in  the  k  sphere. 
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Fig.  3.  Collected  intensity  as  a  function  of  object  depth 
8  for  the  volume  holographic  confocal  microscope  with 
(a)  25‘fim  and  (b)  1-mm  pinholes  and  for  the  confocal  micro¬ 
scope  (with  a  45”-oriented  mirror  replacing  the  volume  holo¬ 
gram)  with  (c)  25‘fim  (d)  1-mm  pinholes.  Location  5  =  0 
corresponds  to  the  depth  of  the  reference  surface  (at  the  fo¬ 
cal  plane  of  the  objective  lens).  All  curves  are  normalized 
such  that  their  peak  values  equal  1. 
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X  coordinate  [^m] 

Fig.  4.  Two-dimensional  scanning  confocal  image  (recon¬ 
structed  intensity  map)  of  the  silicon  microstructure  ob¬ 
tained  with  the  volume  holographic  microscope  shown 
in  Fig.  1 

collector's  spot  size)  and  1  mm.  The  intensity  FWHM 
is  (0.8  ±  0.1)  /mm  for  both  curves,  in  close  agreement 
with  the  value  of  ^0.75  yu.m  predicted  by  Eqs.  (3)  and 
(4).  Note,  however,  that  the  pedestal  of  curve  (b) 
is  higher  because  of  scattered  light  that  is  reaching 
the  detector  (i.e.,  the  d3niamic  range  of  the  measure¬ 
ment  is  slightly  decreased).  By  contrast,  the  depth- 
discrimination  capability  of  the  confocal  microscope 
[curves  (c)  and  (d)]  is  degraded  for  the  1-mm  aperture. 

We  used  the  pinhole-free  confocal  microscope  to 
obtain  a  scanned  image  of  the  silicon  microstructure, 
as  shown  in  Fig.  4.  The  imaged  portion  contained  a 
trench  20  fim  wide  and  5  ^tm  deep.  The  reference 
surface  for  recording  the  hologram  was  outside  the 


trench.  The  image  of  the  trench  corresponds  to  the 
dark  region  in  Fig.  4,  because  the  bottom  of  the  trench 
is  out  of  focus.  We  sampled  only  five  planes  along  y 
and  one  along  z  to  minimize  inaccuracies  that  were  due 
to  the  backlash  of  the  translation  stage  and  the  decay  of 
the  hologram.  A  dense  three-dimensional  scan  could 
have  been  obtained  with  a  piezoelectric  deflector  and  a 
fixed  hologram. 

In  conclusion,  we  have  demonstrated  confocal  scan¬ 
ning  microscopy  by  use  of  a  volume  hologram  as  a 
shift-variant  element  matched  to  object  depth.  The 
d3mamic  range  of  volume  holographic  confocal  imag¬ 
ing  depends  on  the  holographic  diffraction  efficiency 
(in  our  experiment  it  was  «10"^)  and  is  material  lim¬ 
ited.  Single-hologram  efficiencies  as  high  as  100% 
have  been  demonstrated,®  albeit  with  thinner  materi¬ 
als  and,  hence,  poorer  Bragg  selectivity.  Volume  holo¬ 
grams  also  permit  the  use  of  other  imaging  modes,  e.g., 
color-selective  (hyperspectral)  tomographic  imaging®  or 
superresolution  by  use  of  complex  filtering,’  ®  in  combi¬ 
nation  with  the  pinhole-free  confocal  imaging  principle. 
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We  propose  the  application  of  volume  holography  to  four¬ 
dimensional  (4-D)  spatiospectral  imaging.  The  proposed  systems 
use  materials  and  techniques  developed  for  holographic  data 
storage  and  interconnections  to  capture  three-dimensional  {3-D) 
spatial  and  one-dimensional  (l-D)  spectral  information  about 
a  remote  light  source  or  scatterer.  We  analyze  case  studies  of 
simple  architectures  using  spherical-reference  volume  holograms 
as  imaging  elements  in  a  fluorescence  confocal  microscope  ar¬ 
rangement  and  demonstrate  the  equivalence  of  the  holographic 
degeneracies  with  a  slicing  operation  on  the  reconstructing  in¬ 
coherent  source.  We  develop  a  general  theoretical  framework  for 
the  diffraction  of  random  fields  from  volume  holograms  and  show 
that  the  formulation  can  be  used  as  an  imaging  design  tool. 
Applications  and  future  directions  are  also  discussed. 

Keywords — Holography,  microscopy,  optical  imaging,  tomog¬ 
raphy. 


I.  Introduction 

The  introduction  of  volume  holography  in  a  seminal 
paper  by  van  Heerden  [1]  was  soon  followed  by  the 
discovery  of  appropriate  materials  through  the  effect  of 
“optical  damage”  [2],  which  later  became  known  as  the 
photorefractive  effect  [3].  Since  then,  volume  holograms 
have  been  popular  in  a  number  of  subareas  of  optical 
information  processing,  namely  data  storage  [1],  [4]-[6], 
interconnects  and  artificial  neural  networks  [7],  [8],  and 
communications  [9]-[13].  To  date,  commercial  applications 
of  thick  volume  holograms  are  for  spectral  filtering  [14] 
and  three-dimensional  (3-D)  storage  devices.  In  this  paper 
we  introduce  a  novel  application  of  volume  holography  to 
multidimensional  imaging. 
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Optical  imaging  is  in  the  midst  of  a  revolutionary  shift 
from  analog  to  digital  systems.  The  most  apparent  aspects 
of  this  shift  are  the  ubiquitous  availability  of  digitized 
images  and  the  use  of  digital  networks  to  transmit  images. 
Deeper  aspects  of  the  shift  to  digital  techniques  are  only  be¬ 
ginning  to  be  explored,  however.  For  example,  the  physical 
analogy  between  the  detected  field  and  the  perceived  object 
which  is  the  basis  of  classical  imaging  need  not  be  present 
in  a  digital  system.  In  classical  systems,  a  two-dimensional 
(2-D)  focal  plane  pattern  is  used  to  represent  the  object  in 
spite  of  the  fact  that  the  object  is  usually  3D.  The  goal  in 
building  a  classical  system  is  to  make  the  field  distribution 
on  the  sensor  plane  appear  as  similar  as  possible  to  the 
object  viewed  from  the  same  perspective.  Digital  systems, 
in  contrast,  use  sensor  data  to  reconstruct  the  object  in  its 
native  3-D  space.  Since  the  digital  system  does  not  directly 
display  sensor  data,  sensor  data  need  not  look  like  the  ob¬ 
ject.  The  goal  in  designing  a  digital  system  is  to  maximize 
the  detected  object  information  so  as  to  allow  an  accurate 
object  model  to  be  constructed.  In  many  cases,  it  may  not  be 
possible  to  obtain  simultaneously  information  on  all  object 
features.  For  example,  capture  of  polarization  data  may  pre¬ 
clude  capture  of  spectral  data  or  reduce  spatial  resolution, 
capture  of  temporal  variations  may  limit  3-D  resolution, 
etc.  In  view  of  these  tradeoffs,  digital  systems  are  designed 
to  optimize  the  capture  of  specific  features  of  interest. 

Imaging  system  design  has  been  the  primary  subject  of 
physical  optics  for  millenia  and  the  state  of  development 
of  these  systems  is  very  high.  While  volume  holograms 
can  replicate  the  function  of  imaging  system  components, 
such  as  lenses,  beam  splitters,  and  spatial  or  spectral  filters, 
holograms  do  not  out  perform  conventional  components  for 
these  functions.  Volume  holography  as  a  tool  is  extremely 
attractive  in  emerging  digital  imaging  systems,  however, 
because  volume  holograms  have  more  design  degrees  of 
freedom  per  unit  system  aperture  than  any  other  optical 
component.  Design  complexity  allows  volume  holograms 
to  extract  more  sophisticated  features  from  fields,  enabling 
sensor  design  to  target  features  for  object  reconstruction. 
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Volume  holograms  for  complex  field  transformation  and 
feature  extraction  have  been  highly  developed  in  the  context 
of  holographic  storage  and  interconnection.  Digital  data 
storage,  where  each  stored  hologram  corresponds  to  a 
page  of  information,  is  the  most  straighforward  applica¬ 
tion.  Despite  this  apparent  simplicity,  system  geometry  is 
extremely  important  to  the  capacity  and  function  of  data 
storage.  On  the  next  level  of  complexity,  artificial  neural 
networks  have  used  holographic  mappings  for  dendritic 
interconnections.  Before  the  spectacular  improvement  of 
very  large  scale  integration  (VLSI)  technology  in  the  1990’s 
[15],  [16],  volume  holograms  were  considered  as  a  primary 
contender  for  the  efficient  storage  and  implementation  of 
the  massive  interconnections  needed  for  complex  pattern 
recognition  tasks.  Many  of  the  design  considerations  from 
data  storage  and  neural  net  systems  can  be  applied  to 
the  design  of  holograms  for  imaging  applications.  As  will 
become  evident  in  the  remainder  of  the  paper,  some  of  the 
fundamental  properties  of  holographic  storage  techniques, 
in  particular  the  spatial  selectivity  and  degeneracies  of 
spherical  reference  volume  holograms  [17],  can  be  applied 
verbatim  to  imaging.  Even  though  the  architectures  we 
study  here  are  different  than  the  disk  geometry  of  [17], 
the  similarity  simplifies  our  intuitive  understanding  of  the 
problem. 

The  structure  of  the  paper  is  as  follows.  Section  II 
provides  an  extensive  introduction  to  holographic  storage 
and  some  of  the  issues  arising  when  building  a  volume 
holographic  system.  In  Section  III  we  touch  upon  the 
primary  issues  arising  in  computational  imaging  systems 
and  show  as  a  simple  example  that  the  performance  of  the 
common  fluorescence  microscope  arrangement  improves 
when  the  collector  lens  is  replaced  by  a  volume  hologram. 
In  Section  IV  we  analyze  three  simple  implementations  of  a 
particular  transformation,  a  matched  filter  to  a  point  source, 
using  volume  holograms.  We  show  that,  when  viewed  on 
a  fiat  camera  detector,  the  diffracted  field  reconstructs  a 
color-variant  slice  of  the  originating  incoherent  source,  and 
we  derive  the  slice  shape  as  a  function  of  the  recording 
and  reconstructing  geometries.  In  Section  V  we  develop 
a  general  procedure,  formally  equivalent  to  the  Hopkins 
integral,  for  the  calculation  of  diffraction  of  random  optical 
fields  from  volume  holograms.  Our  formulation  leads  to  a 
design  process,  based  on  coherent  mode  decomposition,  for 
constructing  a  volume  hologram  capable  of  shaping  the  co¬ 
herence  properties  of  the  optical  field  arbitrarily,  within  the 
allowable  degrees  of  freedom.  We  conclude  in  Section  VI 
by  discussing  design  considerations  for  multidimensional 
imaging  systems,  their  markets,  and  applications. 

II.  Holographic  Storage 

Holographic  storage  is  motivated  by  high  overall  data 
capacity  and  parallel  access.  It  was  introduced  by  van 
Heerden  [  1  ],  who  first  noted  the  similarity  between  X-ray 
diffraction  from  periodic  crystal  lattices  and  light  diffraction 
from  volume  gratings  and  proposed  utilizing  this  effect  to 
superimpose  and  selectively  retrieve  multiple  holograms 


in  the  same  material  volume,  each  hologram  storing  one 
page  of  information.  The  maximum  number  of  resolvable 
voxels  that  can  be  stored  inside  a  volume  V  at  wavelength 
A  is  y/A^.  This  corresponds  to  an  order  of  10  Tbits/cm^ 
for  green  light.  The  parallelism,  or  the  maximum  number 
of  resolvable  pixels  that  can  fit  in  a  single  page  (i.e., 
an  individual  hologram),  is  bounded  above  roughly  by 
y2/3y^2  Pqj.  light,  this  is  0.4  Gbits/cm^,  with  a 
data  rate  of  several  Gbits/s  if  the  page  size  is  actually  1  cm 
X  1  cm,  and  it  takes  no  more  than  a  few  milliseconds  to 
integrate  each  individual  hologram  on  the  detector.  Neither 
of  these  upper  bounds  has  ever  been  achieved  in  practice 
because  of  material  and  device  limitations. 

A  typical  holographic  storage  system  is  shown  in  Fig.  1 . 
The  hologram  is  recorded  by  illuminating  a  photosensitive 
material  with  the  interference  pattern  formed  by  two  coher¬ 
ent  light  beams,  the  reference  and  signal.  The  signal  beam 
contains  the  information  to  be  stored  in  the  form  of  trans¬ 
verse  phase  or  amplitude  modulation  of  the  beam  profile, 
imposed  by  a  spatial  light  modulator  (SLM).  The  reference 
beam  contains  no  information,  except  the  “identity”  of 
the  hologram.  For  example,  in  the  most  common  form  of 
holographic  storage,  called  “angle-multiplexing”  [18y[20], 
which  is  depicted  in  Fig.  1 ,  the  reference  beam  for  the  mth 
hologram  is  a  plane  wave  incident  at  angle  6„i.  After  the 
exposure  is  complete,  each  hologram  ideally  contributes 
an  equal  amount  of  spatial  modulation  to  the  refractive 
index  of  the  material.  The  mth  hologram  is  then  accessed 
selectively  by  illuminating  the  exposed  material  with  the 
corresponding  plane  wave  at  angle  0„,.  If  the  original 
recording  reference  beams  were  appropriately  spaced,  then 
the  diffracted  light  contains  significant  reconstruction  from 
the  mth  hologram  only.  The  remaining  holograms  are 
Bragg  mismatched,  i.e„  they  are  read  out  by  the  incident 
beam,  but  their  reconstructions,  when  integrated  over  the 
entire  volume  of  the  material,  cancel  out  to  zero.  In  the 
common  configuration  of  Fig.  1,  the  angular  separation 
between  adjacent  holograms  must  be  equal,  approximately, 
to  an  integral  multiple  of 


This  quantity  is  known  as  angle  Bragg  selectivity.  Since 
is  proportional  to  A/L,  the  selectivity  improves  by  using 
shorter  wavelengths  or  thicker  materials.  It  is  important 
to  note  that  the  multiplexed  holograms  share  the  entire 
volume  of  the  recording  material;  therefore,  holographic 
storage  is  fundamentally  different  than  layered  volume 
storage  methods,  such  as  the  digital  video  disk  (DVD)  and 
two-photon  storage  [21].  One  might  think  of  the  process 
of  Bragg  matching  a  single  hologram  in  the  presence 
of  multiple  holograms  sharing  the  medium  as  similar  to 
tuning  a  receiver  to  a  radio  station;  the  matching  angle  Om 
corresponds  to  the  resonance  frequency  of  the  receiver,  and 
the  Bragg  separation  A6  corresponds  to  the  quality  factor 
Q  that  determines  the  receiver  bandwidth. 

Angle  multiplexing  has  been  by  far  the  most  popu¬ 
lar  technique  in  experimental  demonstrations.  The  angular 
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Fig.  1.  A  common  holographic  memory  architecture.  The  7?tth  hologram  is  recorded  by  the 
interference  of  the  beams  from  the  “reference”  (incident  at  $m)  and  “signal”  arms  (incident  at 
angle  0).  The  information  to  be  stored  is  modulated  on  the  signal  wavefront  by  the  SLM.  When 
the  hologram  is  illuminated  by  a  plane  wave  incident  at  angle  dm  from  the  reference  arm,  the 
mth  stored  page  is  diffracted  into  the  “reconstruction”  arm  and  is  focused  onto  the  camera.  This 
scheme  is  called  “angle  multiplexing.” 


deflection  required  to  record  and  access  different  holo¬ 
grams  has  been  implemented  by  electromechanical  actua¬ 
tion  of  off-the-shelf  commercial  mirrors  [5],  [6],  [22]-[24], 
magnetic  actuation  of  micromachined  mirror  flaps  [25], 
acoustooptic  deflection  [26],  [27],  and  liquid-crystal-based 
electrooptic  deflection  [28],  [29]. 

Alternative  multiplexing  methods  have  also  been  devised. 
For  example,  using  a  plane  wave  reference  beam,  the 
reconstruction  is  also  sensitive  to  the  wavelength  of  the 
incident  beam  [18],  [19],  [30],  [31].  With  widely  tunable 
visible  and  near-IR  lasers  becoming  more  common,  com¬ 
pact,  long  lived,  and  affordable,  the  elimination  of  the  need 
for  an  angular  deflector  makes  wavelength  multiplexing  a 
more  attractive  choice.  Another  method  without  mechanical 
addressing  requirement  is  phase-code  multiplexing  [32] 
where  the  reference  beams  are  implemented  as  a  set  of 
orthogonal  codes  and  addressed  using  a  phase  SLM.  Even 
simpler  is  the  implementation  of  shift  multiplexing,  which 
requires  a  reference  beam  that  is  either  a  collection  of 
plane  waves  with  a  regular  relative  angle  displacement 
[33]  or  which  is  a  spherical  wave  [17].  In  both  cases, 
individual  holograms  are  accessed  by  relative  translation 
between  the  reference  and  the  recording  medium.  The 
required  shift  between  adjacent  holograms  is  typically  of  the 
order  of  a  few  micrometers.  The  shift  could  be  implemented 
acoustooptically,  but  mechanical  translation  is  simpler  and 
well  characterized  because  of  the  popularity  of  optical 
storage  disks  [34].  Therefore,  the  latter  has  been  the  method 
of  choice  in  high-capacity  experiments  [35],  [36].  The 
properties  of  spherical  reference  volume  holograms  will  be 
revisited  in  detail  in  Section  IV. 

The  techniques  mentioned  so  far  make  use  of  Bragg  mis¬ 
match  to  multiplex  holograms.  Further  increase  in  capacity 
may  be  obtained  by  synthetically  increasing  the  aperture  of 
the  hologram  using  the  motion  of  the  reference  beam.  In  the 
holographic  storage  jargon,  these  techniques  are  referred 
to  as  “fractal”  [37].  Recent  implementations  include  the 


“peristrophic”  multiplexing  method  [38]  and  the  hybrid 
angle-wavelength  multiplexing  method  [39].  The  aperture 
increase  is  effected  by  use  of  the  degeneracy  effects  that 
will  be  derived  for  some  specific  geometries,  but  in  quite 
a  different  context,  in  Section  IV-C. 

With  a  wide  choice  of  well-understood  multiplexing 
techniques  available,  the  next  critical  system  issue  is  the 
material  [40],  which  is  determined  by  the  application. 
We  consider  photorefractive  and  photopolymer  materials 
only,  because  so  far  they  have  been  the  most  popular  in 
experiments  of  erasable  and  permanent  holographic  storage, 
respectively.  A  complete  review  of  available  holographic 
storage  materials  [41]  is  outside  the  scope  of  this  paper. 

Photorefractive  crystals,  such  as  Fe-doped  LiNbOs, 
SrxBai-xNbOa  (SBN:x),  and  BaTiOs  were  the  first 
materials  to  be  used  for  holographic  storage  [3].  During 
recording,  the  refractive  index  change  occurs  via  the 
electrooptic  effect  after  a  spatially  varying  space-charge 
field  is  established  in  the  crystal  from  the  diffusion  or 
drift  of  photo-excited  charges  away  from  the  illuminated 
regions  [42]-[44].  The  space-charge  field  sustains  itself 
after  removal  of  the  recording  beams  but  decays  because 
of  thermal  electronic  excitation  in  the  dark,  or  uniform 
photo-excitation  during  hologram  readout.  Decay  occurs 
also  as  a  result  of  superimposing  more  holograms  in  the 
same  location  of  the  material.  As  a  result  of  the  erasure 
of  existing  holograms  when  new  holograms  are  recorded, 
the  dynamic  range  of  the  material  is  not  fully  utilized, 
and  the  diffraction  efficiency  (defined  as  the  portion  of 
the  reference  beam  power  diffracted  into  the  hologram)  of 
M  >  1  equal-strength  holograms  is  [45],  [46] 


7]{M)  = 


M2 


(2) 


The  parameter  M/#  (pronounced  “M-number”)  depends 
highly  on  material  parameters,  such  as  absorption  coef¬ 
ficient,  doping  levels,  recombination  lifetimes,  etc.,  but 
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also  on  the  beam  profiles  and  intensities  and  stability  of 
the  experimental  arrangement;  it  is,  therefore,  a  system 
parameter  [46].  Typical  photorefractives  have  M/1  or  less, 
but  there  are  exceptions  [22], 

Photorefractive  holograms  are  semipermanent,  and, 
therefore,  appropriate  for  optically  erasable,  rewritable, 
and  refreshable  random  access  memory  architectures 
[5],  [22H24],  [29],  [47],  or  when  dynamic  holography 
is  required,  e.g.,  two-wave  mixing  [48],  [49],  phase 
conjugation  [50],  [51],  optical  novelty  filters  [52],  self- 
waveguiding  [53],  [54],  etc.  Photorefractives  are  often  used 
also  in  applications  that  require  permanent  storage,  because 
the  ciystal  thickness  can  be  large  (several  millimeters 
or  centimeters),  thus  providing  high  capacity.  A  number 
of  techniques  exist  for  recording  permanent  holograms 
in  photorefractives  and  include  thermal  fixing  [55]”[60], 
electrical  fixing  [61]~[65],  two-lambda  readout  [66]-[70], 
and  two-photon  recording  [71H75].  A  comprehensive 
review  of  nonvolatile  photorefractive  storage  is  given  in 
[76]. 

A  different  class  of  holographic  recording  mechanisms 
is  based  on  photochemical  changes  initiated  by  exposure 
to  the  recording  beams.  The  most  common  example  is 
photoinduced  polymerization  in  the  DuPont  polymer  HRF- 
150  [77]-[79],  where  recording  occurs  as  refractive  index 
modulation  because  of  density  changes  in  the  exposed 
areas;  it  is  permanent  and  does  not  significantly  degrade 
over  time.  Despite  the  different  recording  mechanism,  the 
diffraction  efficiency  as  a  function  of  number  of  superim¬ 
posed  holograms  still  follows  the  rule  (2).  The  HRF-150 
has  been  demonstrated  to  have  approximately  M/6,  and 
has  been  used  successfully  in  a  number  of  high-capacity 
demonstrations  of  holographic  storage  [35],  [80],  [81]. 

The  selection  of  material  and  multiplexing  technique 
depends  on  the  application.  Storage  in  photopolymers  is 
permanent,  hence  they  target  read-only  (ROM)  or  write- 
once-read-many  (WORM)  storage  applications.  Unfortu¬ 
nately,  the  thickness  of  photopolymer  films  is  limited  by 
considerations  of  mechanical  stability  and  optical  quality. 
The  highest  capacity  ever  achieved  in  the  DuPont  polymer 
is  12  bits/^m^  [35]  using  shift  multiplexing  with  a  100  fj,m 
thick  film.  This  surface  density  is  higher  than  the  DVD- 
ROM  by  a  factor  of  two.  Recently,  samples  of  thickness  up 
to  5  mm  were  fabricated  using  a  poly(methyl-methacrylate) 
(PMMA)  polymer  matrix  to  host  the  photosensitive  material 
phenanthrenequinone  (PQ)  [82]-[84].  Theoretical  calcula¬ 
tions  [17],  [85]  show  that  the  achievable  density  at  5  mm 
hologram  thickness  is  as  high  as  200  bits///m^.  Therefore, 
PQ-doped  PMMA  seems  promising  as  a  replacement  to  the 
DuPont  HRF-150  polymer  and  nonvolatile  photorefractive 
storage  for  permanent  high-density  holographic  memories. 

Other  systems  issues  that  are  important  for  holographic 
storage  are  page-oriented  error  correction  [86]-[88]  and 
channel  modulation  [89],  [90],  pixel  matching  [91]  (i.e., 
minimizing  aberration  distortion  by  using  unit  magnifi¬ 
cation  in  the  optical  system  between  the  SLM  and  the 
detector),  and  the  location  of  the  hologram  with  respect  to 
the  imaging  system  [92]  (i.e.,  whether  the  hologram  should 


Fig.  2.  Operation  of  the  angle-multiplexed  holographic  memory 
of  Fig.  1  in  correlator  mode. 


be  located  on  the  focal  or  pupil  plane  of  the  imaging  system 
that  maps  the  SLM  on  the  detector  plane).  A  complete 
review  of  these  issues  is  outside  the  scope  of  the  present 
paper. 

The  function  of  volume  holograms  as  correlators  [93] 
has  been  traditionally  an  important  application  of  holo¬ 
graphic  memories  oriented  toward  optical  pattern  recog¬ 
nition  [94]-[96].  Suppose  M  patterns  fm  (m  =  1, . . .  ,M) 
are  stored  in  a  holographic  memory.  If  the  memory  is 
illuminated  by  a  new  pattern  g  along  the  path  of  the  signal 
beam,  and  a  Fourier-transforming  lens  is  placed  on  the 
continuation  reference  path  (see  Fig.  2),  then  at  the  focal 
plane  one  obtains  the  correlations  g  ★  fm  of  the  novel 
pattern  with  all  the  stored  patterns  at  once.  The  parallel 
correlation  operation  is  obtained  at  the  expense  of  losing 
shift  invariance  in  one  dimension  at  the  output  plane.  This 
mode  of  operation  of  a  holographic  memory  has  been 
successfully  used  in  a  number  of  applications  [97]-[99].  In 
Sections  IV  and  V  we  will  show  that  the  volume  hologram 
correlates  its  internal  modes  with  the  input  field.  This 
function  is  useful  as  an  imaging  operation. 

III.  3-D  Imaging  and  Volume  Holography 

A.  Types  of  Imaging  Systems 

An  optical  imaging  system  transfers  information  about 
an  object  to  the  user,  using  light  as  information  carrier. 
The  amount  and  quality  of  the  transmitted  information  is 
determined  by  the  propagation  properties  of  light.  Free 
space  propagation  has  the  effect  of  delocalizing  the  object 
features,  “blurring”  the  image.  Optical  elements,  such  as 
lenses,  are  used  to  compensate  propagation  and  recover  the 
object  features  locally  or  bring  the  image  “in  focus.” 

Most  imaging  instruments  assume  planar  objects,  i.e., 
objects  that  can  be  described  by  a  two-variable  function 
defined  on  a  surface  transverse  to  the  optical  axis  (see 
Fig.  3).  The  optical  system  performs  an  analog  linear 
transformation  on  the  transverse  field  intensity  distribution, 
and  the  image  appears  at  the  final  detection  stage.  The 
imaging  task  is  more  demanding  for  3-D  objects,  because 
it  requires  compensation  of  light  propagation  effects  in 
three  dimensions.  Unfortunately  optical  instruments  are 
geared  to  handle  planar  rather  than  volumetric  objects, 
and  optical  detectors  are  also  typically  planar  (2D).  Three- 
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Fig.  3.  (a)  A  planar  imaging  geometry,  (b)  A  volume  imaging 
geometry.  The  dashed  lens  indicates  that  the  imaging  system  is 
usually  more  complicated  than  a  single  lens. 


dimensional  imaging  requires  the  acquisition  of  sets  of 
lower-dimensional  intensity  measurements  (2-D  or  point 
measurements)  and  the  subsequent  formation  of  the  image 
from  these  measurements.  One  selection  for  the  intermedi¬ 
ate  measurements  may  be  2-D  images  of  slices  of  the  3-D 
object.  The  imaging  system  is  then  called  “tomographic.” 
The  content  of  the  intermediate  measurements,  however, 
may  not  resemble  the  object  at  all.  Then,  a  more  com¬ 
plicated  transformation  is  required  to  recover  the  image. 
This  class  of  “computational  imaging”  systems  is  quickly 
becoming  more  popular  as  the  available  digital  processing 
power  increases. 

Three-dimensional  optical  imaging  schemes  may  be  clas¬ 
sified  into  five  broad  categories:  scanned  systems;  scene 
analysis  systems;  projective  systems;  interferometric  sys¬ 
tems;  and  modal  systems.  Scanned  systems  include  laser 
spot  scanners,  confocal  microscopes,  and  laser  fluorescence 
microscopes.  These  systems  are  effective  but  slow,  since 
the  volume  data  are  acquired  one  spot  at  a  time.  Scene 
analysis  systems  combine  expert  systems  and  geometry  to 
computationally  reconstruct  objects;  they  require  substantial 
prior  object  knowledge.  Projective  systems  combine  ray 
optics  and  inverse-Radon  or  similar  transforms  to  recon¬ 
struct  objects  and  work  best  with  high  depth  of  field  optical 
components.  Interferometric  systems  include  holographic 
schemes  and  coherence  tomography;  they  are  very  powerful 
and  general  but  are  subject  to  noise  concerns.  Modal  sys¬ 
tems  take  the  most  general  approach,  detecting  the  state  of 
all  optical  modes  and  attempting  a  computational  inversion. 
All  five  imaging  system  classes  require  new  approaches  to 
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Fig.  4.  Principle  of  the  confocal  microscope  arrangement.  In 
experimental  configurations,  the  sample  is  sometimes:  1)  reflective, 
when  the  system  is  folded,  sharing  the  same  lens  as  objective 
and  collector,  or  2)  fluorescent,  when  the  radiation  emitted  by  the 
sample  is  at  a  longer  wavelength  and  the  illuminating  radiation  is 
blocked  by  a  color  filter. 


optical  design  and  benefit  from  spatial  and  spectral  filtering. 
Volume  holographic  elements  can  substantially  improve  any 
type  of  imaging  system.  In  this  paper  we  will  illustrate 
this  potential  for  the  cases  of  confocal  microscopy,  tomog¬ 
raphy,  and  coherence  imaging.  The  following  paragraphs 
describe  the  traditional  approaches  to  confocal  microscopy 
and  coherence  imaging  in  more  detail. 

The  confocal  microscope,  invented  by  Minsky  [100], 
operates  by  the  lowest  dimensional  measurements  possible, 
i.e.,  point  measurements.  A  confocal  microscope  is  sketched 
schematically  in  Fig.  4.  It  constructs  a  3-D  image  by 
scanning  the  volume  of  the  specimen  and  obtaining  the 
emitted  intensity  values  one  point  at  a  time.  The  geometry 
of  the  optical  system  is  such  that  light  emitted  locally 
from  a  very  small  portion  of  the  object  only  is  allowed 
to  reach  the  detector.  The  rest  of  the  light  is  rejected 
by  the  aperture  at  the  detector  pupil.  The  proportional 
light  contribution  to  a  single  measurement  as  function  of 
object  coordinates  is  equivalent  to  the  3-D  point-spread 
function  (PSF)  of  the  system;  it  can  be  calculated  accurately 
under  various  aberration  conditions  using  Fourier  optics 
[101],  [102].  Confocal  microscopy  has  been  implemented 
in  many  different  variants  for  improved  light  efficiency  or 
resolution,  e.g.,  differential  interference  [103],  fluorescence 
[104],  two-photon  [105],  etc.;  it  has  been  spectacularly 
successful,  primarily  in  various  applications  of  biological 
and  biomedical  imaging. 

Coherence  imaging  (Fig.  5)  is  an  example  of  compu¬ 
tational  imaging  that  relies  on  global,  rather  than  local, 
measurements.  It  is  based  on  a  fundamental  result,  derived 
independently  by  van  Cittert  and  Zernicke  [106],  [107], 
which  states  that  the  degree  of  statistical  correlation  of 
the  optical  field  in  the  far  zone,  expressed  as  a  complex 
function  over  the  exit  pupil  of  the  imaging  system,  is 
the  Fourier  transform  of  the  object  intensity  distribution. 
Therefore,  the  object  can  be  recovered  by  measuring  the 
coherence  function  through  interferometry  and  then  inverse- 
Fourier  transforming  the  result.  The  application  of  the  van 
Cittert-Zernicke  theorem  in  the  radio  frequency  spectral 
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Fig.  5.  A  system  for  implementing  coherence  imaging  with  a 
“rotational  shear  interferometer’'  (after  [116]).  The  roof  prisms 
rotate  the  image  antisymmetrically  about  the  two  axes,  and  the 
two  versions  are  interfered  at  the  camera  plane. 


region  is  the  basis  of  radio  astronomy  [108],  which  yields 
by  far  the  most  accurate  images  of  the  most  remote  cosmic 
objects.  The  most  common  formulation  of  the  theorem 
relates  the  mutual  coherence  in  a  plane  at  infinity  to  a  2-D 
source  intensity  distribution,  but  extentions  to  3-D  sources 
have  been  derived  by  various  authors  [109]-[1 12],  The  far- 
field  version  of  the  extended  van  Cittert-Zernicke  theorem 
was  recently  implemented  experimentally  [113H115].  A 
full  generalization  of  the  theorem  has  also  been  developed 
and  experimentally  implemented  to  allow  Fresnel  zone 
reconstruction  in  projective  coordinates  [116]. 

In  either  of  these  systems  the  detected  intensity  is  shaped 
by  the  response  of  the  imaging  elements  (in  the  confocal 
microscope,  the  intensity  measurement  results  from  the  field 
received  at  a  single  point,  whereas  in  coherence  imaging 
the  measured  intensity  is  the  result  of  interference  between 
two  or  more  optical  paths).  A  volume  hologram  is  a  more 
general  design  tool.  One  may  think  of  it  as  an  element 
that  modifies  an  optical  beam  continuously  along  an  entire 
volume.  As  such,  it  can  be  designed  to  perform  spatial 
filtering  operations  similar  to  the  confocal  microscope,  but 
it  is  more  sophisticated  because  of  the  additional  third 
degree  of  freedom,  as  we  show  in  an  example  in  Section  III- 
C.  An  even  more  extended  operation  available  by  the 
volume  hologram  is  a  spatiospectral  mapping  between 
points  in  the  object  and  points  on  the  detector.  As  we  will 
see  in  Section  IV-C,  the  so-called  “degeneracy”  properties 
[37]  of  the  volume  hologram  provide  this  mapping;  the 
recording  geometry  is  the  tool  that  allows  the  designer  to 
shape  the  map  structure.  The  most  general  usage  of  volume 
holograms  for  imaging  is  by  way  of  mixing  the  modes  of 
the  field  generated  by  the  object  with  the  modes  of  the 
hologram  through  the  effect  of  volume  diffraction.  Whereas 
the  previous  examples  can  be  classified  as  subcategories 
of  modal  imaging,  volume  holography  allows  arbitrary 
shaping  the  coherence  properties  of  the  scattered  field.  The 
formal  development  of  this  design  technique  is  given  in 
Section  V. 


B.  Imaging  System  Design 

The  impact  of  design  choices  in  individual  optical  com¬ 
ponents  on  system  performance  is  a  critical  issue  for  3-D 


imaging  system  design.  Lens  behavior,  for  example,  has 
been  well  characterized  in  a  large  variety  of  imaging 
conditions,  and  lens  design  is  an  art  in  itself.  Confocal 
microscopy,  along  with  a  large  number  of  high-performance 
imaging  techniques,  make  good  use  of  advances  in  lens  de¬ 
sign.  On  the  other  hand,  in  lensless  imaging  systems  (such 
as  coherence  imaging,  mentioned  above),  one  tries  to  get 
away  from  the  complexity  of  lens  design  by  using  simpler 
elements  (mirrors,  prisms)  to  form  interference  patterns,  and 
subsequently  one  uses  the  computational  power  of  digital 
computers  to  apply  transformations  (Fourier  transforms, 
Fresnel  transforms,  and  possibly  nonlinearities)  on  the 
detected  image  intensity  in  order  to  recover  the  3-D  object. 
With  the  exception  of  digital  computations,  the  design  of  all 
other  imaging  system  elements  is  constrained  by  machining 
accuracy  limitations.  Digital  transformations  themselves  are 
limited  by  the  requirement  of  reasonable  computation  time. 
Therefore,  part  of  the  imaging  design  problem  is  to  achieve 
a  successful  balance  in  splitting  the  imaging  transformations 
to  analog  ones,  performed  by  the  optical  elements,  and 
digital  ones,  performed  by  computers,  according  to  the 
individual  capabilities  of  each  component. 

A  class  of  optical  elements  that  allow  considerable  flex¬ 
ibility  in  their  optical  response  is,  of  course,  holograms.  A 
hologram  is  determined  either  by  the  profiles  of  the  two  op¬ 
tical  beams  that  interfere  to  record  it  or  can  be  fabricated  by 
etching  a  waveform  on  a  suitable  material  (typically  glass). 
In  either  case,  several  sophisticated  devices  are  available 
for  determining  the  hologram  response.  For  example,  in 
the  former  case,  SLM  technology  allows  spatial  amplitude 
and  phase  modulation  of  optical  beams  to  resolution  down 
to  10  /um;  in  the  latter,  photolithography  and  electron  beam 
patterning  have  been  used  to  generate  very  sophisticated 
diffractive  optical  elements  for  communications,  display, 
and  other  applications.  Holograms  have  not  been  very 
popular  as  optical  elements  in  practical  imaging  systems. 
A  notable  exception  is  holographic  interferometry  [117] 
and  two- wavelength  interferometry  [118],  [119],  where 
the  hologram  does  not  function  as  a  fixed  imaging  ele¬ 
ment,  but  rather  as  a  sophisticated  detector  that  captures 
phase  properties  of  the  object.  Bertero  and  collaborators 
[120H126]  have  proposed  a  method  of  superresolving 
confocal  microscopy  using  diffractive  elements  calculated 
based  on  singular  system  theory. 

We  propose  to  use  volume  holograms  as  optical  imaging 
elements  for  one  main  reason:  a  volume  element  provides 
a  larger  number  of  degrees  of  freedom  in  defining  the 
optical  response,  compared  to  a  surface  element  (e.g.,  a  thin 
hologram)  of  the  same  aperture.  This  is  intuitively  obvious 
from  dimensional  arguments  and  was  proven  formally  in 
[127]  and  [128]  using  the  modal  properties  of  electro¬ 
magnetic  fields.  We  will  not  repeat  the  formal  arguments 
here  but  point  out  the  desirable  and  undesirable  features 
of  volume  holography  that  should  be  taken  into  account 
in  the  design  process.  The  main  price  to  pay  for  the 
advanced  design  flexibility  is  that  the  control  problem  of 
defining  the  hologram  response  (i.e.,  “programming”  the 
volume  hologram)  becomes  considerably  more  difficult  and 
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is  accomplished  at  the  expense  of  diffraction  efficiency 
[128].  Other  considerations  that  follow  from  the  description 
of  Section  II  are: 

1)  volume  holography  provides  enormous  storage  capac¬ 
ity;  therefore,  a  large  number  of  degrees  of  freedom 
is  available  to  the  designer  for  shaping  the  optical 
response  and  improving  the  quality  of  the  image; 

2)  the  capacity  goal  should  be  achieved  by  using  as 
small  a  number  of  holograms  as  possible  in  order 
to  maintain  high  individual  diffraction  eificiency  for 
each  hologram; 

3)  the  recording  of  volume  holograms  is  an  expensive, 
material-limited  process  that  should  not  be  performed 
in  real  time;  it  is  better,  therefore,  to  use  volume  holo¬ 
grams  as  fixed  elements  that  have  been  predesigned, 
fabricated  in  the  factory,  and  delivered  to  the  user, 
rather  than  as  dynamic  elements  modifiable  in  real 
time. 

What  function  should  the  volume  hologram  perform 
inside  an  optical  imaging  system?  Unlike  other  optical 
elements,  the  range  of  possible  responses  by  volume  holo¬ 
grams  allows  them  to  perform  several  functions.  We  con¬ 
clude  this  section  by  giving  an  example  of  a  volume 
hologram  as  part  of  a  confocal  imaging  system.  The  more 
complicated  nature  of  the  hologram’s  response  is  fully  de¬ 
veloped  in  Section  IV-C  for  several  recording  geometries. 
In  these  cases,  the  volume  hologram  acts  as  a  local  imaging 
system  by  isolating  specific  light  contributions  arising  from 
spatial  and  spectral  bands  of  the  object  and  mapping  them 
onto  a  2-D  detector.  At  the  end  of  Section  V  we  will  see 
that  a  volume  hologram  may  also  be  designed  to  act  as  a 
global  imaging  instrument  that  forms  correlations  between 
the  light  modes  emitted  (or  scattered)  by  the  object  and  the 
modes  of  the  hologram. 


C.  Example:  Confocal  Imaging  with  a 
Volume  Holographic  Collector 

Consider  again  the  confocal  imaging  system  of  Fig.  4. 
The  most  common  performance  measure  of  such  a  system 
is  “resolution”;  i.e.,  the  size  of  the  minimum  resolvable 
element  within  the  object  volume.  This  is  equivalent  to 
the  volume  where  the  3-D-PSF  of  the  confocal  imaging 
takes  significant  values.  Ideally,  the  3-D  PSF  is  a  6  function 
and  the  resolution  is  infinite,  but  in  real-life  systems  it  is 
nonzero  over  a  finite  volume.  The  confocal  arrangement 
achieves  a  tight  3-D  PSF  by:  1)  illuminating  the  point  of 
interest  inside  the  object  (the  target)  by  k  tightly  focused 
beam,  produced  by  the  objective  lens,  and  2)  re-imaging 
through  the  collector  lens  the  radiation  from  the  target  onto 
a  small  pinhole  aperture  in  front  of  the  detector.  Thus,  point 
radiators  other  than  the  target  are  doubly  inhibited:  1)  they 
are  illuminated  by  an  extended  low-intensity  beam,  whereas 
the  target  is  illuminated  by  the  high-intensity  beam  waist 
and  2)  the  radiation  they  produce  is  rejected  by  the  3-D  PSF 
of  the  collector  because  they  are  away  from  the  focal  point. 


imaging 

lens 


Fig.  6.  Confocal  imaging  arrangement  with  the  collector  lens 
replaced  by  a  volume  hologram  and  a  Fourier  transforming  lens: 
(a)  geometry  for  recording  the  volume  hologram  and  (b)  confocal 
imaging  arrangement. 


Consider  now  the  modified  confocal  imaging  system  of 
Fig.  6(b),  where  the  collector  has  been  replaced  by  a  vol¬ 
ume  hologram  and  a  Fourier- transforming  lens.  The  volume 
hologram  has  been  recorded  by  the  interference  of  a  spheri¬ 
cal  wave  originating  from  the  intended  target  location,  and  a 
plane  wave  oriented  normally  with  respect  to  the  optic  axis 
of  the  spherical  wave,  as  shown  in  Fig.  6(a).  This  recording 
arrangement  is  known  as  “90^^  geometry,”  and  has  been 
popular  in  a  number  of  holographic  storage  demonstrations 
[5],  [6],  [22]-[24].  In  our  imaging  configuration  [Fig.  6(b)], 
the  volume  hologram  captures  the  radiation  emitted  by 
the  object  after  illumination  by  the  focused  input  beam 
produced  by  the  objective.  The  diffracted  light  propagates 
in  the  direction  shown  in  Fig.  6(b)  and  is  then  captured  and 
Fourier  transformed  by  the  lens.  The  pinhole-sized  detector 
is  placed  at  the  focal  point  of  the  lens,  i.e.,  it  captures  the 
dc  component  of  the  diffracted  field. 

Formally,  the  volume  hologram -{-lens  arrangement  forms 
the  correlation  between  the  field  emitted  by  the  object  and 
the  original  signal  beam  [the  spherical  wave  of  Fig.  6(a)]. 
Radiation  emitted  from  the  target  position  at  the  recording 
wavelength  is  identical  to  the  recording  signal  and  is  recon¬ 
structed  on  the  detector.  Radiation  emitted  from  different 
positions  and  at  different  wavelengths  (if  the  object  happens 
to  be  polychromatic)  does  not  correlate  well  with  the 
recording  signal  and  is  not  reconstructed.  The  calculation  of 
the  diffracted  field  as  a  function  of  the  reconstructing  object 
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Fig,  7.  Numerical  comparison  of  fluorescence  confocal  imaging  with  a  lens  collector  and  volume 
holographic  collector.  For  simplicity,  the  fluorescence  wavelength  is  taken  to  be  equal  to  the  probe 
wavelength,  (a)  Geometry  used  in  the  simulation.  Each  plane  is  modeled  as  a  100  x  100  grid  of 
incoherent  radiators  at  the  same  wavelength  A.  (b)  Shape  of  the  original  object,  (c)  Fluorescence 
confocal  reconstruction  using  a  lens  collector  of  aperture  radius  1500A.  located  2500A  from  the  plane 
of  the  letter  “M.”  (d)  Fluorescence  confocal  reconstruction  using  a  volume  holographic  collector 
with  aperture  radius  1500A,  thickness  3000A,  with  its  center  located  2500A  from  the  plane  of 
the  letter  “M.” 
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for  this  geometry  is  given  in  (detail  in  Section  IV-B.  There 
we  will  find  out  that  some  parts  of  the  uncorrelated  radiation 
actually  are  reconstructed,  but  not  at  the  focal  point  of 
the  lens.  Detecting  these  reconstructions  in  an  organized 
way  allows  the  performing  of  interesting  slicing  operations 
on  the  object.  These  will  be  explained  in  Section  IV-C. 
For  the  purposes  of  this  section,  it  suffices  to  note  that,  in 
isolating  the  radiation  emanating  from  the  target  point  and 
rejecting  the  rest,  the  volume  holographic  collector  is  more 
efficient  than  an  equivalent  lens  collector.  The  reason  is 
understood  immediately  upon  comparing  the  3-D  PSF’s  of 
the  confocal  arrangement  with  a  lens  collector  as  opposed  to 
a  volume  hologram.  The  3-D-PSF  calculation  is  performed 
using  volume  diffraction  theory  in  Section  IV-B.  There,  it 
is  shown  that  the  width  of  the  main  lobe  is  the  same  in  both 


cases;  however,  the  sidelobes  are  significantly  suppressed 
in  the  case  of  the  volume  holographic  collector. 

A  numerical  example  demonstrating  the  importance  of 
the  side-lobes  is  given  in  Fig.  7.  In  this  example,  we  nu¬ 
merically  reconstructed  a  fluorescent  3-D  incoherent  object 
with  the  two  cases  of  confocal  microscope  with  a  regular 
lens  and  volume  holographic  collector.  The  resolution  was 
close  to  the  borderline  resolution  allowed  by  the  numerical 
aperture  of  the  lens  collector.  From  the  reconstructions 
we  see  that  the  lens  collector  accumulates  noise  from 
power  diffracted  by  the  sidelobes;  this  is  absent  from 
the  volume  holographic  reconstruction.  The  signal-to-noise 
ratios,  computed  as  the  quadratic  error  between  object 
and  image  normalized  to  the  total  image  intensity,  were 
?^1500  and  ^^^3500,  respectively,  for  the  lens  and  volume 
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Fig,  8.  Schematic  of  a  generic  volume  diffraction  geometry.  The 
probe  field  Ep{r)  and  index  modulation  Ae(r)  are  expressed  in 
the  .ryz  coordinate  system.  For  notational  clarity,  we  use  a  different 
.r'y  r'  coordinate  system  for  the  diffracted  field  £'d(r). 


holographic  collector.  This  improvement  is  not  dramatic, 
but  the  design  can  be  combined  with  matched  filtering 
similar  to  Bertero’s  decomposition  method  [120]“-[126], 
yielding  even  better  results.  This  last  step  is  not  described 
in  this  paper. 

IV.  Diffraction  Properties  of  Volume 
Holograms  with  Spherical  Reference 

As  we  discussed  in  Section  II,  in  most  holographic  ma> 
terials  the  recording  of  a  volume  hologram  is  accom¬ 
plished  through  modulation  of  the  refractive  index.  This 
is  expressed  as  a  function  A£:(r)  of  the  space  coordinate 
r,  for  r  €  Vn,  where  is  the  volume  occupied  by 
the  holographic  material.  A  generalized  version  of  the 
volume  diffraction  geometry,  valid  for  all  the  calculations 
of  this  section,  is  given  in  Fig.  8.  When  the  hologram  is 
illuminated  by  a  probe  field  Ep{r)j  the  diffracted  field 
£^d(r')  is  found  as  the  solution  to  Maxwell’s  equations 
in  an  inhomogeneous  medium,  with  refractive  index  as 
given  above.  The  solution  is  simplified  if  we  assume  that 
the  magnitude  of  the  modulation  is  much  smaller  than  the 
unmodulated  refractive  index  eo 

|Ae(r)|  <  eo,  re  (3) 

because  the  weak  diffraction  approximation  (also  known 
as  “Born’s  approximation”)  can  then  be  applied.  The  dif¬ 
fracted  field  is  given  by 

=  III  £p(r)A.(r)  x  --'H  d=r  (4, 

Vn 

where  k  =  27c/X  is  the  wavenumber  and  the  last  term  in  the 
integrand  is  recognized  as  the  scalar  Green’s  function  for 
free  space.  The  derivation  of  (4)  from  Maxwell’s  equations 
is  beyond  the  scope  of  this  paper. 
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Fig.  9.  Simplified  holographic  recording  geometries  considered 
in  this  paper:  (a)  reflection  geometry  and  (b)  90°  geometry.  The 
reference  and  probe  beams  are  always  spherical  waves.  We  cover 
both  cases  when  the  signal  is  either  spherical  wave  or  a  plane  wave 
for  (a)  in  Sections  IV- A  and  IV-C  and  the  case  of  plane  wave  signal 
only  for  (b)  in  Sections  IV-B  and  IV-C.  The  reconstructed  beam 
depends  on  the  relative  position  and  wavelength  of  the  reference 
and  probe  beams,  the  nature  of  the  signal  beam,  and  the  shape  of 
the  hologram. 


Equation  (4)  has  a  simple  interpretation.  Assume  that 
the  volume  grating  is  composed  of  infinitesimal  scatterers, 
the  strength  of  the  scatterer  located  at  r  G  being 
Ae(r).  Then  the  diffracted  field  is  the  coherent  summation 
of  the  fields  emitted  by  all  the  scatterers  when  they  are 
excited  by  the  incident  field  £’,>(r).  Naturally,  this  picture 
omits  higher  order  scattering,  i.e.,  fields  generated  when  the 
field  scattered  from  one  infinitesimal  scatterer  reaches  other 
infinitesimal  scatterers.  This  omission,  though,  is  consistent 
with  the  weak  scattering  approximation,  which  says  that 
these  higher  order  effects  are  even  weaker  and,  therefore, 
negligible. 

Expression  (4)  is  computationally  efficient  when  spher¬ 
ical  waves  are  involved  in  the  recording  of  the  hologram, 
as  we  will  see  in  the  next  two  sections.  For  other  types  of 
fields,  a  representation  of  the  diffracted  field  and  the  grating 
in  wave- vector  space  works  better  but  is  beyond  the  scope 
of  this  paper.  For  a  more  complete  treatment,  the  reader  is 
referred  to  [129]. 

We  will  be  examining  two  volume  holographic  ge¬ 
ometries,  shown  in  Fig.  9.  In  the  “reflection  geometry” 
[Fig.  9(a)]  the  reference  and  signal  beams  are  incident 
on  two  opposite  faces  of  the  holographic  material  and 
(approximately)  counterpropagating.  Upon  reconstruction, 
the  probe  beam  is  incident  in  the  direction  of  the  reference 
and  the  diffracted  beam  is  generated  as  extension  of  the 
signal,  i.e.,  it  is  counterpropagating,  on  the  same  side 
of  the  medium  as  the  probe  beam.  A  beam  splitter  is 
used  to  separate  the  reconstruction  from  the  probe.  In 
the  “90°  geometry”  [Fig.  9(b)]  the  reference  and  signal 
beam  are  incident  on  two  normal  faces  of  a  cube-like 
recording  medium.  Again,  the  probe  is  incident  from  the 
same  direction  as  the  reference,  and  the  reconstruction 
appears  as  a  continuation  of  the  signal,  but  no  beam  splitter 
is  required  in  this  geometry. 

In  the  next  two  sections,  we  derive  the  basic  formulas 
that  give  the  diffracted  field  as  function  of  the  output 
coordinates  the  recording  beams  and  the  geometry  of  the 
hologram,  for  the  reflection  and  90°  geometry,  respectively. 
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Fig.  10.  Schematic  of  the  reflection  geometry  with  spherical 
wave  reference  and  plane  wave  signal  beams. 


In  Section  IV-C  we  solve  for  the  locus  of  probe  points  and 
wavelengths  that  generate  maximum  reconstructed  intensity 
in  the  (arbitrarily  defined)  output  plane.  The  resulting 
construction  is  called  the  “degeneracy  surface”  of  the 
volume  hologram  and  is  important  because  it  specifies  the 
portion  of  the  object  that  is  “visible”  by  the  hologram  for 
imaging  purposes. 


A.  Reflection  Holograms 

First  we  consider  the  geometry  of  Fig.  10,  with  a  plane 
wave  signal  beam.  The  reference  beam  used  for  recording 
is  a  spherical  wave  at  wavelength  Af  produced  by  a  point 
source  at  rf  =  XfX  +  y^y  +  We  express  this  wave  in 
the  paraxial  approximation,  as 

(5) 


Note  that  we  have  neglected  a  term  of  the  form  l/X{z  —  zt) 
because  it  varies  with  ;2:  much  slower  than  the  exponential 
term.  Such  slowly  varying  terms  will  be  neglected  from 
here  on.  The  signal  beam  is  a  plane  wave  propagating  at 
angle  ix  1  with  respect  to  the  z  axis.  In  the  paraxial 
approximation,  it  is  expressed  as 


£s(r)  =  exp|-i27r^l  -  +i27ru^|.  (6) 


The  modulation  of  the  material  refractive  index  resulting 
from  exposure  to  beams  JSf,  Es  given  by 


Ae{r)  =  \Et{r)  +  E,{r)f.  (7) 


Out  of  the  four  terms  in  the  interference  pattern,  we  will  in¬ 
sert  only  E^{r)Es{r)  in  the  volume  diffraction  equation  (4) 
for  the  remainder  of  this  section.  The  remaining  three  terms 
are  Bragg  mismatched  and  do  not  diffract  significantly. 

The  probe  field  is  a  spherical  wave  at  wavelength  Ap 
emanating  at  Fp  =  XpX  4-  y^y  +  ZpZ.  The  expression  for 
the  probe  field  is 


Epir)  -  exp 


=  exp  ii 


I 


-h  in 


{x  -  +  iy-  Vp)' 

Xp{z  -  Zp) 


'}■ 

(8) 


To  find  the  diffracted  field  at  the  detector  coordinates 
(located  near  the  focus  Fg  of  the  signal  beam)  we  will  use 
Bom’s  diffraction  formula  (4).  We  simplify  by  assuming 
that  the  holographic  medium  is  disk  shaped  with  radius 
R  in  the  xy  plane,  and  thickness  L  along  the  ^  direction, 
and  making  the  paraxial  approximation,  i.e.,  assume  that 
R  is  smaller  than  any  longitudinal  distance  that  the  fields 
propagate.  We  then  obtain 


Ed{r'')=jjJ  £;p(r)Ae(r)  circ  1  reel 


'  exp  <  i2n 


<9, 


The  field  reaching  the  detector  is  obtained  after  a  Fourier- 
transforming  operation  applied  by  the  lens  on  i.e., 

+00 

Mr')  =  Jl  Ea{r") 

—  00 

.exp{-i2.^'^y'}dy'd;,"  (10) 

where  F  is  the  focal  length  of  the  lens  and  constant  phase 
factors  have  been  omitted.  The  limits  of  integration  in  (10) 
are  taken  to  be  infinite  by  assuming  that  the  aperture  of 
the  Fourier  transforming  lens  is  larger  than  the  effective 
aperture  imposed  on  the  diffracted  field  by  the  transverse 
size  R  of  the  volume  hologram.  In  other  words,  we  assume 
that  the  volume  hologram  defines  the  aperture  of  the  system. 
Under  this  condition,  we  can  substitute  (9)  into  (10)  and 
perform  the  x”,  y"  integrations  right  away,  obtaining 

Ea{r')  =  jjj  exp{i7rA(i:)(a:^  +  y^)} 

•  exp  {-i2-K[Bx{z)x  +  By{z)y\} 

f  +y^\ 

•  exp  {inC{z)}  circ  I  — — - j 

•rect(^)d^r  (11) 


where  the  coefficients  A{z),  Bx{z),  By(z),  C{z)  are  given 
by 


A(z) 


1 

Ap(^:  —  ^p) 


1 

Af(z  -  zi) 


Bx{z)  = 
By{z)  = 

Ciz)  = 


Xp 

x' 

Ap(z  — 

1 

1 

V 

ApF 

Vp 

. . 

y' 

> 

*13 

1 

ApF 

4+4 

4  +  yf 

Af(^  Zp^ 

X[{z  -  Z{) 

1  A  x'^  +  y'^ 

^'4 

Af)  ApF2 

(12) 

(13) 

(14) 


(15) 
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To  simplify  the  integral  (11),  we  use  the  following  cylin¬ 
drical  coordinates: 

fa:  =  pcos<^,  Bx(z)  =  B(z)  cos  a(z) 

[y  =  ,^n4.,  B,(z)  =  BizUualz)  <'« 

with  the  inverse  transformations  given  by 

B{Z)  =:  y/KWTB^i^  ^,7) 
\  taii0  =  y/x,  tana(2:)  =  By{z)/Bx{z) 


where  the  sign  of  the  inverse  tangent  is  taken  to  conform 
with  the  quadrant  of  x,  y,  and  Bx{z),  By{z),  respectively. 
Equation  (11)  then  becomes 


/X./Z  /•« 

exp {iT:C{z)}  /  exp  [i'KA{z)p^] 

-L/2  7o 

/exp  {— 227rB(2:)pcos  (0  -  0'(^))}d^pdpdz. 

-TT 


(18) 


The  result  for  the  innermost  integral  is  well  known,  ex¬ 
pressed  in  terms  of  the  zero-order  Bessel  function  of  the 
first  kind  as 


/: 


exp{— z27rB(;?;)pcos((^  ~  <^(^))} 

=  2'kJo{2'kB[z)p).  (19) 


The  next-level  integral  occurs  in  the  calculation  of  the  3-D 
PSF  of  a  lens  near  focus,  and  is  written  as 

J  expi^-^up^'^Jo{vp)pdp  =  C{u,v)  (20) 

where  the  real  and  imaginary  parts  of  the  function  C{u,  v) 
are  expressed  in  terms  of  the  Lommel  functions.  For 
more  details,  the  reader  may  consult  [130,  Section  8.8,  pp. 
435^49].  In  terms  of  the  C  function,  the  diffracted  field 
at  the  detector  is  expressed  as 

.LI2 

£!j(r')  =  27ri^^  /  exp  {z7rC(2:)} 

J-LI2 

'  C(2nA{z)R^ ,2itB{z)R)  dz.  (21) 

The  last  integral  is  calculated  numerically.  Some  properties 
of  the  volume  hologram  are  now  apparent  qualitatively. 


1)  If  the  hologram  is  reconstructed  at  the  recording 
wavelength  (Ap  =  Af),  with  a  probe  source  at  the 
same  location  as  the  reference  source  (rp  =  rf),  and 
the  detector  is  placed  at  the  maximum  of  the  Fourier 
transform  of  the  signal  (x'/F  =  u,  y* /F  =  0),  then 
all  the  exponents  in  (18)  vanish,  and  the  reconstructed 
power  is  maximum.  This  condition  is  known  as  Bragg 
matching. 

2)  If  either  the  reconstruction  wavelength  or  the  probe 
location  change,  the  detector  point  x'/F  =  u,  y^ /F  = 
0  does  not  receive  maximum  power  anymore.  If  the 
power  drops  uniformly  over  the  entire  detector  plane, 
we  say  that  the  hologram  is  Bragg  mismatched.  When 
Ap  and  rp  satisfy  certain  conditions,  though,  then 


Fig.  11.  Contour  plot  of  the  diffracted  intensity  measured  by  a 
detector  at  the  foci  point  x'/F  =  y'/F  =  0  of  the  geometry 
of  Fig.  10,  from  a  point  source  at  position  rp  =  (arp,0,2p) 
illuminating  a  volume  hologram  with  R  =  750A,  L  =  1500A.  The 
same  diffraction  contour  plot  is  obtained  also  from  the  geometries 
of  Figs.  13  and  14. 

significant  power  is  diffracted  into  some  other  point 
on  the  detector  plane  (x'/F  /  w  or  y^ /F  /  0). 
The  locus  of  (Ap,  rp)  over  which  this  is  possible  is 
the  degeneracy  surface  of  the  volume  hologram.  This 
effect  and  how  it  can  be  used  to  extract  tomographic 
slices  of  polychromatic  volume  objects  are  the  topics 
of  Section  IV-C. 

3)  Since  £(•,  •)  describes  the  amplitude  transmitted  from 
a  quadratic  lens  also,  our  result  (21)  shows  that  the 
diffracted  light  from  the  volume  hologram  is  the 
coherent  superposition  of  several  “lenses”  stacked 
in  the  z  direction.  If  the  probe  source  is  at  the 
common  front  focus  of  all  these  virtual  “lenses,” 
then  the  “lenses”  are  all  in  phase  and  give  a  strong 
reconstruction  in  the  back  focal  point  (Bragg  matched 
case).  If  the  probe  moves  around  or  changes  its 
color,  the  “lens”  contributions  will  in  general  be 
out  of  phase  (Bragg-mismatched  case),  except  if  the 
combination  of  probe  position  and  wavelength  and 
observation  position  are  arranged  such  that  the  “lens 
stack”  contributions  are  again  in  phase  (degeneracy 
case). 

The  diffracted  power  received  by  a  fixed  detector  pixel 
(xYF,  y^/F)  when  Ap  =  Af ,  y^  =  0  are  kept  fixed  and  Xp, 
Zp  are  allowed  to  vary  are  plotted  in  Fig.  11.  This  response, 
which  is  common  to  other  recording  geometries  as  well 
(see  below),  should  be  compared  with  Fig.  12,  which  is  the 
transmitted  intensity  captured  by  the  detector  if  the  volume 
hologram  is  replaced  by  a  lens  of  the  same  aperture  as 
function  of  Xp,  Zp.  The  comparison  explains,  e.g.,  why 
the  volume  hologram  is  more  efficient  as  a  collector  in 
a  confocal  microscope  arrangement  (Section  III-C). 

Now  consider  the  case  of  a  reflection  hologram  recorded 
with  a  spherical  wave  signal  beam.  The  geometry  is  drawn 
in  Fig.  13.  The  signal  beam  is  now  a  spherical  wave  coun- 
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Fig.  12.  Contour  plot  of  the  transmitted  intensity,  measured  by 
a  detector  at  the  focal  point  of  a  thin  quadratic  lens  with  aperture 
R  =  750A,  when  illuminated  from  a  point  source  at  position 
rp  =  (3!^p,  0. 2p).  This  plot  is,  within  scaling  factors,  the  same  as 
[130,  Fig.  8.41]  and  is  provided  for  comparison  with  Fig.  11. 


Reference 


Fig.  13.  Schematic  of  the  reflection  geometry  with  spherical 
wave  reference  and  signal  beams. 

The  plot  of  diffracted  power  when  Ap,  r'  and  are 
fixed,  while  Xp,  Zp  vary,  is  virtually  identical  to  that  of 
Fig.  1 1  (this  can  be  verified  by  comparing  the  expressions 
for  the  coelficients  and  the  changes  in  the  exponents  as  a:p, 
Zp  change),  so  it  will  not  be  given  again.  The  degeneracy 
surface  for  this  geometry  will  be  calculated  in  Section  IV-C 
along  with  the  other  recording  geometries. 


terpropagating  with  respect  to  the  reference,  and  coming  to 
a  focus  at  Ts  =  a:sX  +  ysj  +  ZsZ,  The  expression  of  the 
electric  field  for  this  wave  is 

Es{r)  =  exp  i  i2-k— - h 

I  Af  Af(z  -  Zs) 

(22) 

To  find  the  diffracted  field,  we  start  with  an  expression 
similar  to  (9)  with  (22)  substituted  in  the  refractive  index 
modulation  A6(r)  —  E’^{r)Es{r)  and  proceed  as  in  the 
plane-wave  signal  case,  omitting  the  Fourier-transfoim  step 
since  there  is  no  lens  in  the  arrangement  of  Fig.  13.  The 
result  is 

nLf2 

Et\{v^)  =27rR^  I  exp{27rC'(z)} 

J~L/2 

•  C{27vA{z)R^ ,  27rB{z)R)  dz  (23) 
i.e.,  identical  to  (21),  but  with 

A,  ^  ^  1 

M.z)  =  — - T  + 


Ap(2  -  -Zp)  Ap(2  -  z')  \t{z  -  Zf) 
1 


Af(2  -  Zs) 


(24) 


Bx(^)  =  - 

+ 

B,(z)  =  - 

+ 


X'  + 


Ap(^:  -  -2;p)  Ap(^:  -  z')  Af(z  -  Zf) 

Xs 


Af{^  -  Zs) 

vp  _ y 


(25) 


+ 


yt 


Ap(z  -  Zp)  Ap(z  -  z')  Af(z  -  Zf) 

2/s 


Ar(-2:  -  z^) 


(26) 


Af(^  -  .^p)  Ap(z  -  z’)  Af(z  -  Zf) 


.1L±J£  +41 

Af(z-Zs)  \^p 


B.  90°  Geometry  Holograms 

The  90°  geometry  differs  from  the  reflection  geometry 
because  the  paraxial  approximation  for  the  signal  and 
diffracted  beams  is  made  along  the  x  rather  than  the  z 
axis.  This  leads  to  quantitatively  different  expressions  in 
the  diffraction  integrals.  We  will  examine  in  this  section 
the  case  of  a  plane  wave  signal  only,  incident  at  angle 
It  <C  1  with  respect  to  the  x  axis,  as  shown  in  Fig.  14.  The 
reference  and  signal  beams  are 

Edr)  =  exp 

l  Af  Af(^  —  Zf) 


u^\  X  z 


(28) 

(29) 


Es{t)  =  exp  ^  — i!27r^l  — 

For  a  probe  field 

=  exp  +  ] 

l  -  ^P)  j 

(30) 

and  an  observation  point  r"  near  the  x  axis,  the  diffraction 
integral  in  the  paraxial  approximation  is  given  as 

Ea{r")  =  jjj  i;p(r)Ae(r)  circ 

f  o  ~  ^ 

X  exp  <  «27r — - 

Performing  the  Fourier  transform  in  y” ,  z^\  and  sub¬ 
sequently  the  integrals  in  cylindrical  coordinates  as  in 
Section  IV-A  for  the  plane  wave  case,  we  obtain  yet  again 
a  result  of  the  form 

/•V2 

£;j(r')  =27ri?^  /  exp  {i7rC(2:)} 

J-LI2 

^  C{27r A{z)R^,  27rB{z)R)  dz,  (32) 
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Fig.  14.  Schematic  of  the  90°  geometry  with  spherical  wave 
reference  and  plane  wave  signal  beams. 


This  time  the  coefficients  are  given  by 


A{z) 

B.{z) 


By{z) 

C{z) 


1 _ 1 

Ap(^  -  2p)  Af(2  -  zs) 

_ ^p _ I _ 

Ap(^  -  Zp)  \[{z  -  zi) 

y'^  +  z'"^  1  1 

2ApF2 

_  Vp  yt _ ^ 

Ap(^  -  ^p)  Af(a:  -  z[)  XpF 

+  yfy  _  x^  +  yj 

Xi{z  -  Zp)  Xi{z  -  Zi) 

U  7J  1  1  \ 


(33) 


(34) 

(35) 


(36) 


The  change  in  diffracted  power  as  function  of  Zyy  is, 
once  again,  identical  to  Fig.  11,  and  will  not  be  given 
separately.  The  degeneracies  will  be  calculated  immediately 
below. 


C.  Hologram  Degeneracies  and  Multispectral  Tomography 

We  now  turn  to  the  calculation  of  the  hologram  de¬ 
generacies,  i.e.,  the  conditions  for  achieving  significant 
reconstructed  power  even  when  the  probe  field  is  not  a 
replica  of  the  reference  field.  From  the  diffraction  integrals 
(21),  (23),  (32),  we  can  see  that  the  condition  for  obtaining 
significant  reconstruction  is  equivalent  to  setting  the  argu¬ 
ments  of  £(*,  •)  as  well  as  the  varying  portion  of  C(')  equal 
to  zero.  If  these  conditions  are  not  satisfied,  the  value  of 
the  integral  decreases,  i.e.,  Bragg  mismatch  occurs. 

Obviously,  in  each  geometry  there  are  several  param¬ 
eters  that  one  may  manipulate  in  order  to  eliminate  the 
exponents.  The  selection  depends  on  the  application.  We 
are  interested  in  the  case  of  a  reconstructing  field  produced 
by  an  extended  polychromatic  object,  and  a  planar  two- 
dimensional  detector  located  at  the  exit  plane  of  the  system. 
Then,  the  parametrization  of  interest  is  the  locus  and 


wavelength  of  the  point  radiators  within  the  object  that 
produce  maximum  reconstructed  power  on  a  particular  pixel 
of  the  detector  as  a  function  of  the  pixel  coordinates  on  the 
detector.  We  will  see  that  this  parametrization  results,  in 
each  case,  in  a  surface  in  object  space;  this  is  the  degeneracy 
surface  for  our  chosen  planar  detector  geometry  (nonplanar 
detector  surfaces  would  yield  different  degeneracy  surfaces 
but  are  hard  to  come  about  in  practice).  The  reconstruct¬ 
ing  wavelength  must  vary  across  the  degeneracy  surface, 
too,  for  maximum  reconstructed  power.  Thus,  the  field 
diffracted  off  the  volume  hologram  “isolates”  a  surface 
subset  of  radiators  in  space,  as  well  as  filters  them  in  color. 
This  is  equivalent  to  a  tomographic  slicing  operation  in 
both  space  and  spectral  domains.  By  scanning  the  volume 
hologram  in  two  dimensions,  the  full  four-dimensional  (4- 
D)  reconstruction  of  the  object  (in  space  and  color)  can 
be  obtained.  We  now  derive  the  degeneracy  surface  shapes 
for  various  holographic  recording  geometries,  in  order  to 
demonstrate  the  operation  of  the  volume  hologram  as  a 
spatiospectral  filter. 

We  begin  with  the  case  of  a  plane  wave  signal,  reflection 
geometry  hologram,  as  in  the  first  part  of  Section  IV-A.  For 
later  convenience,  we  define  the  parameter  p  =  Ap/Af.  To 
derive  the  degeneracy  surface,  we  set  all  coefficients  A{z), 
Bx{z)j  By{z)^  C{z)  equal  to  zero,  at  least  to  first  order  in 
z.  From  (12)  we  obtain 


Zi 


(37) 


From  (13),  and  using  (37),  follows 

Xp  =  JTf  +  Zf 

whereas  (14)  and  (37)  yield 


Zi  y' 

2/p  =  2/f  +  - 

u  F 


(38) 


(39) 


Substituting  into  (15)  results  in  the  following  quadratic 
equation  in  p 


Dy?  +  Gju,  -  =  0  (40) 

where 


Therefore,  the  degeneracy  surface  is  obtained  by  setting  p 
equal  to  the  root  of  (40)  that  is  closest  to  1  in  magnitude  and 
then  substituting  in  (37)-(39).  The  result  for  a  particular 
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Fig.  15.  Degeneracy  surface  (space  and  color)  of  the  reflection  recording  geometry  with  a  plane 
wave  signal,  computed  numerically.  The  parameters  for  this  plot  were  rf  =  (100,  —100,  -2500)A, 
u  =  0,— 0.3  <  jF.y’ JF  <  0.3.  In  the  plot,  the  blue  color  corresponds  to  //  =  0.899  and 
the  purple  to  ^  =  1.0. 


numerical  example  is  shown  in  Fig.  15.  Two  important 
points  about  the  surface  of  Fig.  15  should  be  noted. 

1)  The  degeneracy  surface  is  not  infinitely  thin  as  im¬ 
plied  by  the  drawing  but  has  a  finite  thickness  because 
the  reconstructed  intensity  from  points  and  colors 
near  the  surface  is  not  zero  but  falls  off  smoothly 
according  to  (21). 

2)  The  diffraction  efficiency  from  points  belonging  to 
the  degeneracy  surface  is  not  uniformly  1  but  falls 
off  toward  the  surface  edges  because  higher  order  z 
terms  in  the  exponents  cause  weak  Bragg  mismatch; 
this  deviation  from  true  degeneracy  is  also  calculated 
by  use  of  (21). 

Numerical  results  for  the  surface  thickness  and  deviation 
from  degeneracy  are  not  given  here  but  can  be  calculated 
easily.  These  remarks  also  hold  for  the  surfaces  computed 
later  in  this  section. 

The  derivation  of  the  degeneracy  surfaces  for  other 
recording  geometries  is  similar  to  the  one  just  described 
and  will  not  be  given  here;  only  the  results  will  be  quoted. 

For  the  spherical  wave  signal  reflection  geometry  case, 
fi  is  the  root,  closest  in  magnitude  to  1,  of 


+  =  0 


where 


(44) 


(45) 


Zf  z  ^ 


=4-2 


F2  • 


(46) 

(47) 


The  spatial  coordinates  of  the  degeneracy  surface  are  ob¬ 
tained  from 


A  numerical  example  is  given  in  Fig.  16.  It  is  interesting 
to  note  that  the  degeneracy  surface  in  this  case  is  identical 
to  the  surface  obtained  in  the  case  of  a  plane  wave  signal 
(derived  immediately  above)  with  Xs  =  —uzs,  2/s  =  0?  and 
inverted  output  coordinates  {x^  ^  —a:',  ^  —  2/0- 

For  the  plane  wave  signal  90°  geometry  case,  the 
quadratic  equation  for  is  also  of  the  form 

=  0  (51) 


where 


Zf  Zi 


(52) 
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Fig.  16.  Degeneracy  surface  (space  and  color)  of  the  reflection  recording  geometry  with  a  spherical 
wave  signal,  computed  numerically.  The  parameters  for  this  plot  were  rf  =  (—100, 100,  —2500)  A, 
Ts  =  (0,0,  — 3000)A,  — 500A  <  x',y'  <  500A,^r'  =  — 3000A.  In  the  plot,  the  blue  color 
corresponds  to  y  =  0.966  and  the  purple  to  /i  =  1.0. 


After  solving  for  ^  as  the  root  of  the  quadratic  with 
magnitude  closest  to  1,  the  spatial  coordinates  are  obtained 
from 


where 


Zf  xj  xl 

\  Zf  J  \zt  x' ) 

^  yl  +  zl  _  ^  _  ^xl  +  yf  _  ^y'y^ 


H=l  +  ^. 


(59) 

(60) 
(61) 


_£f 

(55) 

=  -/x( 

,  2)'^[  2F^  ) 

(56) 

yp 

Vi 

(57) 

Zf, 

Zi 

F 

A  numerical  example  is  given  in  Fig.  17. 

For  the  sake  of  completeness,  we  also  give  the  result  for 
the  degeneracy  surface  of  a  volume  hologram  recorded  with 
a  spherical  wave  signal  in  the  90*^  geometry  (see  Fig.  18  for 
the  notation).  The  calculation  of  the  diffracted  field  cannot 
be  done  under  the  framework  of  Sections  IV- A  and  IV- 
B  and  will  not  be  given  here.  However,  the  degeneracy 
derivation  is  straightforward.  It  results  also  in  a  quadratic 
equation  for  /x  of  the  form 

+  Gti- H  =  Q  (58) 


The  spatial  coordinates  of  the  degeneracy  surface  are  given 
by 


with  jx  computed  from  (58).  A  numerical  example  is  given 
in  Fig.  19. 


V.  Statistical  Properties  of  Diffraction 
FROM  Volume  Gratings 

In  the  examples  of  the  previous  sections,  we  made 
assumptions  about  the  nature  of  the  random  objects  recon¬ 
structing  the  volume  hologram,  as  well  as  about  the  form  of 
the  hologram  itself.  In  particular,  we  worked  with  volume 
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Fig.  17.  Degeneracy  surface  (space  and  color)  of  the  90°  recording  geometry  with  a  plane  wave 
signal,  computed  numerically.  The  parameters  for  this  plot  were  rf  =  (100,  — 100,  ■~2500)A, 
u  =  0,“0.3  <  x^lF^y'lF  <  0.3.  In  the  plot,  the  blue  color  corresponds  to  //  =  0.619  and 
the  purple  to  y,  =  1.246. 


holograms  recorded  with  a  spherical  reference  beam  and  de¬ 
rived  their  operation  as  point-source  correlators  for  imaging 
under  two  conditions:  1)  when  replacing  the  collector  lens 
in  a  fluorescent  confocal  microscope  with  a  monochromatic 
object  (Section  III-C),  they  improve  the  resolution  of  the 
regular  confocal  arrangement,  and  2)  when  reconstructing 
a  polychromatic  (4-D)  object,  they  isolate  a  surface  in 
the  space  and  wavelength  domain,  allowing  the  full  4-D 
tomographic  reconstruction  of  the  object  with  appropriate 
scanning  (Section  IV-C).  Color-selective  tomography  is  a 
unique  property  of  volume  holograms  as  optical  elements 
and  cannot  be  achieved  by  a  design  that  incorporates  planar 
optical  elements  only.  In  this  section,  we  generalize  the 
volume  hologram  operation  as  shaping  the  modes  of  the 
object  field  through  correlation  (mixing)  with  the  modes  of 
the  volume  hologram. 

As  we  mentioned  already  in  Section  III- A,  computational 
imaging  is  performed,  in  general,  by  transformations  on  the 
intensity  values  of  the  field  at  the  detector  plane.  When 
viewed  as  an  analysis  problem,  this  means  that  one  needs 
to  know  the  statistical  properties  of  the  intensity  values  at 
the  output  plane  as  a  function  of  the  imaging  system  and 
the  statistics  of  the  object.  From  the  design  point  of  view, 
it  is  desired  to  construct  the  imaging  system  so  as  to  shape 
the  output  intensity  statistics  appropriately  for  the  task  at 
hand.  The  intensity  transformation  law  between  the  source 
intensity  distribution  4(^0  and  the  intensity  distribution  at 
the  detector  space  /d(r)  is,  in  the  case  of  a  completely 


Fig.  18.  Schematic  of  the  90°  geometry  with  sperical  wave 
reference  and  signal  beams. 

incoherent  source,  of  the  form 

Idir')=  [  h{r)h{r',r)d^r  (65) 

JVs 

where  the  transfer  function  r)  describes  the  operation 
of  the  optical  system. 

In  many  imaging  systems,  there  is  a  single  optical  beam 
propagating  between  the  object  and  image.  Such  was  the 
operation  of  the  volume  holographic  system  of  Figs.  6, 
10,  13,  14,  and  18.  We  would  like  to  characterize  the 
operation  of  a  volume  hologram  in  configurations  where 
two  or  more  beams  interfere  on  the  detector  plane.  In  such 
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Fig,  19.  Degeneracy  surface  (space  and  color)  of  the  90°  recording  geometry  with  a  spherical 
wave  signal,  computed  numerically.  The  parameters  for  this  plot  were  rf  =  (—100, 100,  — 2500)A, 
Fs  =  (3000, 0,0) A,  — 500A  <  500 A,  =  3000A,  In  the  plot,  the  blue  color  corresponds 

to  ^  =  0.979  and  the  purple  to  //  =  1.0. 


interferometric  systems,  the  /d(r')  measurement  contains 
information  about  the  statistical  correlation  properties  of 
the  field  at  the  output.  We  therefore  need  to  model  the 
effect  of  volume  diffraction  on  the  correlation  properties  of 
a  random  optical  field.  To  this  end,  in  the  remainder  of  this 
section,  we  first  introduce  the  notation  and  terminology  of 
statistical  optics  [131],  [132]  and  redeiive  the  deterministic 
correlation  property  of  volume  diffraction;  we  then  gener¬ 
alize  the  correlation  property  in  a  statistical  framework  and 
use  the  modal  decomposition  of  both  the  field  coherence 
function  and  the  hologram  refractive  index  modulation  in 
order  to  formulate  the  operation  of  the  volume  hologram 
as  a  design  problem. 

Suppose  the  geometry  of  an  imaging  system  is  such 
that  the  fields  from  two  observation  points  r2(^^0 

interfere  at  every  point  r'  in  the  detector  space.  The 
measurement  then  is  (dropping  the  r'  dependence  of 
r2  for  notational  simplicity) 

/d(r')  =  E.V.{|£d(r'i)  +  £d(r'2)|T-  (66) 

Using  the  definitions 

/d(r;)  =E.V.{|£;d(r;)|T  j  =  1,2  (67) 
rd(r;,r^,r)  =E.\.{E*{r[,t)E{r'^,t +  r)}  (68) 

where  r  is  the  relative  time  delay  between  the  two  optical 
paths  and  Fa  is  the  second-order  correlation  function  of  the 
random  optical  field,  we  obtain  for  the  detected  intensity 
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the  result 

Jd(r')  =  /d(ri)  +  /d(r2)  +  2  Re  rd(ri,  r'j,  t).  (69) 

The  last  result  states  that  the  interferometric  measurement 
contains  the  field  correlation  information  superimposed  on  a 
quasi-uniform  bright  background  (typically,  the  variation  of 
Fd(ri)  with  is  very  small).  Instead  of  ra(ri,  r25  if  is 
typical  to  assume  that  the  field  is  quasi-monochromatic,  and 
that  the  path  delay  is  r  =  0,  and  use  the  mutual  intensity 
Ja(ri,r2),  defined  as 

Jd(r'i,r'2)  =  rd(ri,r2,0).  (70) 

Relation  (69)  then  becomes 

/d(r')  =  hir'i)  +  /d(r2)  +  2  Re  Jd(r'i,  r'j).  (71) 

These  results  are  well  known  and  hold  for  any  inter¬ 
ferometric  optical  system;  we  seek  to  compute  the  effect 
of  a  volume  hologram  on  the  mutual  intensity  J^x{r[,T2). 
Before  getting  to  that  point,  though,  it  is  useful  to  repeat 
a  deterministic  property  of  volume  diffraction:  if  a  volume 
hologram  is  illuminated  by  a  complex  (coherent)  field,  then 
the  diffracted  field  contains  the  2-D  correlation  between 
the  input  field  and  the  pattem(s)  stored  in  the  modulated 
refractive  index  of  the  hologram.  The  generalization  to 
statistical  fields  is  then  obvious. 

Let  Vs  be  the  volume  where  a  three-dimensional 
monochromatic  (at  wavelength  A  =  27r/fc)  probe  light 
source  is  confined,  and  £^p(r")  the  field  emitted  by  an 
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infinitesimal  source  volume  at  r"  €  Let  be  the 
volume  where  a  3-D  perturbation  Ae(r)  of  the  refractive 
index  is  confined  (Ac(r)  =  0  for  r  ^  Vh),  i.e.,  a  volume 
hologram.  When  the  field  scattered  by  Vs  reaches 
a  secondary  diffracted  field  E^\{V)  (r'  ^  Ks,  1^)  is 
produced.  Let  n  denote  a  vector  of  unit  magnitude  in 
an  arbitrary  direction  that  from  here  on  we  refer  to  as 
“optical  axis.”  The  3-D  spatial  spectrum  of  the  source  field 
is  denoted  as 

£s(k)  =  [  Es{r)  exp{-ik  •  r}  d^r  (72) 
7r3 

with  a  similar  expression  for  E^\.  We  also  denote 


products  of  orthogonal  modes.  For  the  source  field,  the 
decomposition  is  written  as  follows: 

Js(ri,r2)  =  E  O'm  C,(ri)V-’m(r2)  (76) 

m 

where  the  are  the  eigenfunctions  and  the  am  the 
eigenvalues  of  the  Friedholm-type  integral  equation 

/  >^s(ri,r2)V’m(r2)  d^ri  =  OmV’mCri).  (77) 

JVs 

The  orthogonality  of  the  eigenfunctions  is  expressed  by 
f  'i/’m(r)^m'(r)  d^r  =  (78) 

JVs 


kx  =  kxn,  A:||=k-n  (|kx|^  +  fejj  = 


The  correlation  property  is  then  expressed  as  follows: 


£d(k)  = 


(73) 


for  k  satisfying  |k|  =  k,  where  the  ★  denotes  correlation 
and  Ae*  is  the  complex  conjugate  of  Ac.  The  proof  of  this 
statement  is  given  in  Appendix  1. 

The  generalization  of  (73)  to  a  random  field  is  straightfor¬ 
ward.  We  define  the  spatial  Fourier  transform  of  the  source 
mutual  intensity  function  as 


J.(ki,k2)=  jj 


'  exp  {-z(ki  •  ri  +  k2  •  ra)}  d^ri  d^r2  (74) 


with  a  similar  expression  for  Jd(ki,k2).  Then,  under  the 
constraint  |ki|  =  |k2|  =  k,  Jd(ki,k2)  is  related  to 
Js(ki,k2)  through 


It  is  straightforward  to  prove  that  the  decomposition  also 
holds  in  the  spatial-spectral  domain;  i.e., 

Js(ki,k2)  =  Q;m'?^m(ki)VWk2)-  (79) 

m 

Since  the  volume  occupied  by  the  hologram  is  finite, 
we  can  decompose  Ae(r)  into  a  Fourier  series,  according  to 

d^r.  (80) 

j 

The  orthogonality  condition  for  the  basis  {^j}j^|jq3  is 
expressed  as 

/  </>j(r)<j!'j'(r)d2r  =  6jj-.  (81) 

JVt-c 

We  seek  to  compute  the  coherent  mode  decomposition  of 
the  mutual  intensity  of  the  diffracted  field  in  terms  of  the 
modes  (76)  of  the  source  mutual  intensity  and  the  modes 
(80)  of  the  volume  hologram.  In  Appendix  III  we  show  that 

^d(ki,k2)  =  ^  ^  (82) 


KwHwKwKw 


AeV/-ki) 


•  -  k2)  d^k"  j.  dX,±-  (75) 

Similar  to  Appendix  I,  we  used  the  notation  Kj  —  kj^x  + 
hy/k^  —  m-,xp,  j  =  1,2.  The  proof  of  (75)  is  given 
in  Appendix  II.  (This  expression  also  follows  directly  by 
specializing  a  result  derived  in  [112]  to  the  case  of  a 
volume  hologram;  the  full  proof  is  given  here  for  com¬ 
pleteness.)  This  is  also  a  correlation  relation  between  the 
six-dimensional  functions  Jd(ki,k2)  and  Ac*(ki)Ac(k2) 
constrained  on  the  4-D  sphere  |ki|  =  |k2|  =  k. 

We  now  seek  to  cast  (75)  as  a  design  problem.  To  this 
end,  we  decompose  both  the  Fourier-transformed  mutual 
intensities  Ja(ki,k2),  Js(ki,k2)  and  the  index  modulation 
Ae(k)  in  their  respective  modes  and  show  how  the  modes 
mix  as  a  result  of  volume  diffraction. 

The  coherent  mode  decomposition  property  for  a  general 
random  field  states  that,  under  some  general  existence 
and  continuity  conditions  for  the  cross- spectral  density, 
the  quantity  J(ri,r2)  can  be  decomposed  into  a  sum  of 


where,  for  |k|  =  k 

=  r  E  -  k)^.  (83) 

^11  J  7r2  /ujj 


In  the  space  domain,  the  above  expression  can  be  rewritten 
as 


Vm(r)  = 


J  JVs 

■  -  k'  -  r|)}  j3j./ 


(84) 


Expressions  (83)  and  (84)  are  the  key  results  of  this 
section:  they  express  the  modal  structure  of  the  diffracted 
field  as  a  mixture  of  the  coherence  modes  of  the  source  and 
the  modes  of  the  volume  hologram  [note  that  the  modes  in 
(83)  or  (84)  are  not  orthogonal  but  can  be  orthonormalized 
in  straightforward  fashion  with  a  Gramm-Schmidt  proce¬ 
dure].  The  mixing  occurs  primarily  through  the  coupling 
constants  ej,  i.e.,  the  Fourier  components  of  the  refractive 
index  modulation,  while  the  modes  of  the  hologram  itself 
act  as  weighting  functions.  Thus,  the  design  problem  is 
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defined  in  terms  of  (82)  and  (83)  or  (84):  specify  the  Fourier 
components  ej  such  that  the  desired  mutual  coherence 
function  Ja(ki,k2)  is  synthesized. 

We  will  not  attempt  examples  of  modal  design  in  this 
paper,  but  will  point  out  two  conclusions  that  follow  from 
our  results. 

1)  In  the  examples  of  Sections  IIFC  and  IV,  the  field 
is  correlated  with  the  particular  spherical-reference 
mode  of  the  volume  hologram.  This  action  is  similar 
to  a  matched  filter.  The  response,  described  by  the 
degeneracy  surfaces,  is  the  set  of  object  field  modes 
that  correlate  with  the  hologram  mode. 

2)  The  response  of  the  volume  hologram  can  become 
much  richer  simply  by  following  the  modal  synthesis 
approach  delineated  before;  this  is  because  the  cou¬ 
pling  coefficients  ej  provide  three  degrees  of  design 
freedom  (j  is  a  three-element  vector)  thanks  to  the 
3-D  nature  of  the  volume  hologram. 

VI.  Conclusions  and  Discussion 

In  this  paper  we  introduced  the  concept  of  using  volume 
holograms  for  multidimensional  imaging  and  demonstrated 
numerically  various  imaging  functions  that  a  volume  holo¬ 
gram  can  perform.  The  specific  geometries  of  confocal 
microscopy  with  volume  holographic  collector  and  color- 
selective  tomography  are  of  immediate  interest,  and  we 
are  currently  working  on  experimental  demonstrations.  The 
modal  approach  outlined  in  Section  V  extends  optical  en¬ 
gineering  design  from  the  traditional  surface-to-surface 
transformations  to  the  most  general  domain  of  volume 
transformations.  This  “3-D  optical  engineering”  approach 
is  well  tuned  to  the  construction  of  hybrid  optical  systems, 
where  optics  perform  analog  transformations  at  the  front 
end,  while  back-plane  digital  electronic  computations  pro¬ 
vide  the  transformations  that  optical  elements  cannot  do 
well  (e.g.,  Fourier  transforms  on  the  intensity  function, 
nonlinearities,  etc.)  thus  completing  the  generality  of  the 
system.  Including  volume  holograms  as  analog  optical 
elements  in  the  design  permits  maximum  flexibility  in  the 
quest  for  the  optimal  system. 

The  commercial  value  of  ubiquitous  imaging  will  un¬ 
doubtedly  increase  rapidly  with  the  ongoing  revolutions 
of  digital  and  hybrid  imaging.  Humans  are  known  to 
be  “visual”  animals,  i.e.,  in  most  situations  they  respond 
optimally  to  visual  stimulation.  In  many  instances,  so¬ 
phisticated  visual  interfaces  can  drastically  improve  the 
performance  of  critical  social  functions  as  diverse  as  edu¬ 
cation  of  young  children  and  national  or  corporate  security. 
Advanced  interfaces  are  also  necessary  in  the  domains  of 
machine  vision  and  machine  learning  for  the  improvement 
of  algorithms  or  even  the  invention  of  new  ones  based  on 
the  availability  of  more  complete  visual  information  about 
the  surrounding  world.  The  endowment  of  optical  systems 
with  powerful  elements,  such  as  volume  holograms,  and 
new  design  approaches  geared  toward  advanced  imaging 
and  visual  interface  is  critical  for  the  achievement  of  these 
technological  advances  in  the  near  future. 


Appendix  I 

Proof  of  the  Correlation  Property  for 
THE  Diffraction  of  a  Complex  Field 
FROM  A  Volume  Hologram 

We  will  now  prove  assertion  (73).  Let  us  denote  by 


(85) 


the  field  incident  on  location  r  €  of  the  volume  holo¬ 
gram,  where  i?"  =  |r  —  r"|.  Using  Born’s  approximation, 
the  field  diffracted  from  the  volume  hologram  is  given  by 


Eair')=  f  d^r  (86) 

JVh  ^ 

“X  X 

•  d^r  d^r"  (87) 


where  R  =  |r'  -  r|.  We  now  use  Weyl’s  identity  for  the 
expansion  of  a  point  source  in  a  spectrum  of  plane  waves 

exp{ik\r\} 

M 

=  ^  exp  jikj.  •  rx  +  \/k‘^  -  |kx|V||  |  d^kx- 

(88) 


By  using  the  notation 

K(kx)  =  kx  +  ny/k^  -  |kxp 

for  the  “valid”  wave  vectors  (i.e.,  the  wave  vectors  that 
belong  to  the  sphere  |k|  =  k,  also  known  as  the  fc-sphere), 
Weyl’s  identity  is  written  in  simpler  form 


(89) 


exp{*A;  r }  f  1  r  -  /,  n  i  j2. 

- M - "=  /  T  {*K(kx)  ■  r)  d^kx- 

1^1  ^11 

Substituting  (89)  into  (87)  we  obtain  successively 

Ea{r')=  f  [  f  f  E.{r")Af{r) 

JVs  Jv-H  7r2 
exp  {?/t(ki,x)  •  (r^  -  r)} 

*1,11 

exp  {z/t(k2,x)  •  (r-  r")} 

*2,11 

d^ki^x  d^k2,x  d^r  d®r" 

•  E^{r")  exp  {m(k2,x)  •  r"}  d®r"^ 

•  (  /  A.(r) 

\JV-H 

•  exp  {i(/t(k2,x)  -  K(ki,x))  •  r}  d^r^ 

•exp{?/«(ki,x)  r  } - -i— - ^  (91) 

*1,11*2,11 


(90) 
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=  /  /  ^s(K(k2,±))Ae(/t(k2,x)  - /e(ki.x)) 

Jn^  JR* 


j  -  /ir  \  /I  X  d2k2,x 

•  exp  {^/c(kl,x)  •  r  } - r-^— r - !- 

«1, 11^2, II 


-L 


k\\ 


•  exp{iK(ki,x)  •  . 

*1,11 


(92) 


(93) 


The  last  statement  is  equivalent  to  (73),  which  proves  the 
assertion. 


Appendix  II 

Proof  of  the  Correlation  Property 
FOR  Statistical  Fields 

Assuming  Es  is  one  realization  of  the  random  process 
representing  the  object,  we  form  the  correlations  according 
to 


Mr",  r")  =  E.y.{Es(r")£:(r")}  (94) 

Ja(ri,r'2)=E.V.{£a(r'i)i;;;(r'2)}.  (95) 


Rearranging  the  integrals  and  summations,  we  rewrite  the 
above  expression  as 


The  last  expression  is  equivalent  to  (82)  by  using  definition 
(83)  for  the  v?m’s.  The  alternative  expression  (84)  follows 
from  (83)  by  using  Weyl’s  identity  in  reverse,  in  order  to 
go  back  to  the  space  domain. 
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Substituting  Born’s  diffraction  formula  (87)  and  (94)  into 
(95),  we  obtain 


Mr[,r',)=  f  I  f  f 


J,(r'/,r")Ae(ri)Ae*(r2) 

^  exp{zA:i^2}  exp{zA:i^i} 

^  ^  Wi 

exp  {ikR2} 


d^r"  d®r^'  d®ri  d^r2.  (96) 


R2 


By  using  Weyl’s  identity  and  proceeding  as  in  Appendix  I, 
we  obtain  (75)  after  a  long  but  straightforward  calculation. 


Appendix  III 

Derivation  of  the  Coherent  Mode  Decomposition  of 
THE  Field  Diffracted  by  a  Volume  Hologram 

To  prove  (82)  we  substitute  (76)  and  (80)  into  (75).  This 
leads  to  the  expression 


=  E  E  E 

ji  h 

ff 

jl  *1.11*2, ||A:;',,|A:"/^' 

JK 

•  (k"  -  ^1)^2  {14  -  ka) 

(97) 
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We  use  the  coherent  mode  representation  of  the  cross-spectral  density  to  derive  a  modal 
analog  of  the  constant  radiance  theorem  with  general  applicability  to  linear  optical 
systems.  We  use  the  theorem  to  consider  the  relationship  between  spatial  detector 
geometry  and  multiplexing  capacity. 

Optical  sensors,  such  as  cameras  and  grating  spectrometers,  are  usually  designed  for  isomorphic 
mappings  between  physical  parameters  and  measured  data.  With  advances  in  electronic  detector 
arrays  and  digital  processors,  however,  sensor  systems  that  are  deliberately  designed  with 
nonisomorphic  mappings  are  increasingly  popular.  These  are  termed  “multiplex”  systems 
because  they  measure  linear  combinations  of  target  data  rather  than  the  data  itself.  Multiplexing 
has  a  long  history  in  spectroscopy,  as  in  Fourier  and  Hadamard  transform  systems  [1,2],  and  in 
x-ray  tomography.  Motivations  for  multiplex  spectrometry  include  the  “throughput”  and 
“multiplex”  advantages.  The  throughput  advantage  is  that  all  of  the  power  in  the  target  beam  is 
detected  and  used  to  generate  the  target  spectrum.  The  multiplex  advantage  is  that  linear 
combinations  of  the  target  data  can  increase  the  mean  power  per  measurement  and  increase  the 
reconstructed  signal  to  noise  ratio  in  the  presence  of  additive  noise.  The  multiplex  advantage  is 
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substantial  in  the  infrared,  where  thermal  noise  dominates,  but  is  less  compelling  in  the  visible, 
where  shot  noise  is  dominant  [3]. 

There  has  recently  been  considerable  interest  in  multiplex  techniques  for  digital  imaging. 
Conventional  multiplexing  spectroscopy  filters  the  field  through  a  pinhole,  slit  or  fiber  to  reduce 
the  field  to  a  single  spatial  mode.  Spatial  filtering  may  also  be  used  in  scanned  imaging  systems, 
as  in  optical  coherence  tomography  [4].  More  commonly,  however,  imaging  systems  pass 
multiple  spatial  modes.  We  focus  our  analysis  on  systems  described  by  coherent  mode 
decompositions  of  coherence  functions.  Multiplex  imaging  has  been  demonstrated  in  a  variety  of 
multimode  systems  [5-10].  Multimode  multiplexing  is  used  in  imaging  systems  to  capture  data 
for  which  no  isomorphic  mapping  is  possible,  as  in  data  radiated  by  three-dimensional  sources, 
or  to  improve  the  efficiency  of  data  capture  through  target  specific  mappings  of  spatial,  spectral, 
polarization  and  coherence  data.  Until  recently,  the  nature  of  measureable  sources  and  the 
structure  of  sensor  systems  was  determined  by  the  nature  of  analog  processing  in  optical 
systems.  Emerging  multiplex  systems  emphasize  efficient  data  transfer  over  analog  data 
inversion  under  the  assumption  that  inversion  can  be  digitally  implemented  after  data  capture. 

Some  analyses  have  directly  extended  the  multiplex  advantages  of  spectroscopy  to  imaging 
systems.  The  conventional  analysis  assumes,  however,  that  detector  noise  is  independent  of  the 
multiplexing  scheme.  A  primary  goal  of  this  letter  is  to  show  that  this  assumption  cannot  hold  for 
multiple  spatial  mode  systems.  Multiplexing  of  multiple  modes  is  constrained  by  the  Second 
Law  of  Thermodynamics.  The  Second  Law  restricts  fan-in  and  fan-out  in  optical  beams  and  has 
broad  application  to  imaging,  solar  power  collection  [1 1-13],  and  optical  interconnections  [14]. 
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Second  Law  restrictions  on  radiance  and  fan-in  transformations  of  optical  beams  have  been 
expressed  in  many  forms  and  with  many  names.  The  most  most  common  form  is  the  constant 
radiance  theorem  [15].  These  theorems  are  most  commonly  derived  using  ray  optics  [12],  but  has 
also  been  derived  using  wave  theory  [16]  and  thermodynamic  arguments  [1 1].  As  suggested  by 
the  name,  the  constant  radiance  theorem  shows  that  no  linear  optical  system  can  increase  the 
radiance  in  transformations  between  incoherent  planes. 

In  isomorphic  imaging  systems  there  is  direct  analogy  between  the  physical  state  of  the  field  at 
significant  points  and  source  parameters  and  one  can  easily  prove  the  constant  radiance  theorem 
by  ray  arguments.  The  situation  is  more  complex  in  multiplex  imaging  because  there  need  not  be 
any  particular  physical  significance  to  the  field  at  any  point.  This  letter  develops  an  alternative 
version  of  Second  Law  constraints  that  allows  analysis  of  systems  based  on  any  linear  optical 
transformations  and  in  arbitrary  coherence  states.  We  achieve  this  goal  using  the  modal  theory  of 
partial  coherence  developed  by  Wolf  [17]. 

We  limit  our  discussion  to  fields  propagating  in  source-free  unbounded  homogeneous  media,  in 
which  case  second  order  coherence  functions  of  the  radiant  field  are  completely  determined  by 
measures  between  points  on  a  bounding  surface.  We  can  describe  the  state  of  these  fields  and 
transformations  on  them  using  the  cross-spectral  density  W(r,,r2,  v)and  appropriate  derivatives 
for  points  r,  and  Tj  across  a  surface  bounding  the  source. 

The  cross-spectral  density  is  defined  as  the  Fourier  transform  of  the  mutual  coherence  function 
r(r,,rj,  r)  [18].  W(r,,r2,  v)  is  Hermitian  and  positive  definite  in  transformations  on  functions  of 
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r,  and  ,  by  which  properties  one  can  show  that  it  can  be  represented  by  a  coherent  mode 
expansion  of  the  form 


W(r, ,rj ,  A„  (v)  £  (r, ,  (r^ ,  v)  ( 1 ) 

n 

where  (v)  is  real  and  positive  and  where  the  family  of  functions  ^„(r,  v)  are  orthonormal  such 
that  (r,  v)<l>„  (r,  v)d V  =  5„„ . 

In  analogy  with  radiance  transformations,  we  are  interested  in  transformations  of  the  coherent 
mode  distribution  for  fields  propagating  between  planes.  A  linear  optical  system  transforms 
coherent  modes  defined  on  an  input  surface  into  distributions  on  an  output  surface  under  the 
impulse  response  h(r,r',v  ),  where  r  and  r'are  input  and  output  position  vectors,  respectively. 
After  propagation  through  the  system  the  cross-spectral  density  is 

W(r,',r/,  v)=Y,A„  v)  v)  ( 2) 


where  ^i^„(r',v)=|^„(r,v)h(r,r',v  )d^r .  r/  and  correspond  to  points  on  a  the  output  surface  of 

the  system.  The  functions  y/„(r,v)  are  not  necessarily  orthogonal  [19].  The  cross-spectral 
density  across  the  output  aperture  may  be  described  by  a  new  coherent  mode  decomposition 

W(r,',r/,  v)=J^A„  (v)(l);(r,',v)d)„(r2',v)  ( 3) 
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where  the  functions  <I)„(r,v)  are  a  new  set  of  orthonormal  coherent  modes  and  the  functions 
An  (v)  are  new  eigenvalues.  The  new  coherent  modes  are  complete  over  the  possible  states  of 
the  field  in  the  output  plane,  meaning  that  the  states  {^^„(r,v)can  be  expanded  as 
v)=^Cnn,<E>„(r,  v) .  Using  the  orthonormality  of  the  coherent  modes  we  know  from  Eq.  (3) 

m 

that 

JW(r,',r/,  v)a)„(r,',v)(b;(r2',v)dV,'dV=A„  (v)  ( 4) 

Substituting  for  W  in  Eq.  (4)  from  Eq.  (2)  we  find 

=  (5) 

n 

Power  conservation  requirements  allow  us  to  constrain  the  transformation  coefficients  c„„ . 
Conservation  of  power  on  propagation  through  the  system  leads  to  the  requirement  that 
(*■,  v)  y/„  (r,  v)d  V  <  1 ,  which  implies  that  ^  |c„„  |^  <  1 . 


has  the  properties  of  a  probability  distribution.  From  the  weighting  implicit  to  this 
distribution  we  see  immediately  that  no  linear  transformation  can  increase  the  maximum  mode 
amplitude,  which  is  to  say  that  [ ^  .  This  result  is  analogous  to  the  constant 

radiance  theorem  in  that  the  brightest  possible  focused  spot  drawn  from  the  field  will  be 
proportional  to  amplitude  of  the  brightest  mode. 
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If  we  have  no  prior  knowledge  of  the  original  eigenvalues,  as  in  cases  for  which  the  values 
represent  encodable  communications,  image  or  memory  data,  the  distribution  of  can  be  taken 
as  a  measure  of  the  entropy  of  the  system.  Defining  the  normalized  eigenvalue 
one  constructs  the  entropy  of  the  system  as  [20] 

n 

«  =  -Si.log4,  (6) 

n 

One  can  show  by  induction  that  any  change  in  that  redistributes  the  largest  into  smaller 

ranges  will  increase  H.  Thus,  our  proof  that  one  cannot  increase  the  largest  eigenvalue  is  simply 
an  expression  of  the  second  taw  of  thermodynamics.  Of  course,  linear  optical  transformations  are 
generally  reversible  and  thus  ought  not  transform  the  entropy  at  all.  Any  transformation  that 
changes  the  eigenvalue  spectrum  must  be  irreversible  to  satisfy  the  Second  Law.  In  practical 
systems  irreversibility  arises  from  many  factors,  including  phase  loss  and  nonlinearity  on 
absorption  from  the  field,  segmentation  of  field  regions  by  hard  obscurations  and  slight 
mechanical  instabilities. 

In  applying  our  results  to  multiplex  imaging  we  consider  a  spatially  parallel  array  of  square  law 
spatially  and  temporally  integrating  detectors.  The  state  of  the  i'*"  such  detector  can  be  modeled 
as 

(7) 

J 

where  the  spatial  integral  is  over  the  detector  area,  4 ,  and  the  spectral  integral  is  over  all  the 
entire  spectrum.  x-(v)is  the  spectral  efficiency  of  the  detector,  a  position  vector  on  the 
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detector  surface.  S(r^,v)=W(r^,r^,  v)  is  the  power  spectral  density  evaluated  at  r^.  W(r^,r^,  v) 
has  been  transformed  on  propagation  as  discussed  above.  The  power  coupling  coefficient  from 
the  j'**  coherent  mode  in  the  detector  plane  to  the  i*  detector  isy^j(v)  =  x’(v)  . 

Using  the  orthonormality  of  the  coherent  modes  we  know  that  (v)  <k[v)N  ,  where  N  is 

ij 

the  number  of  modes  and  equality  applies  if  and  only  if  the  aggregate  detector  integration  area 
covers  the  entire  sensor  plane.  If  we  assume  that  the  modal  distribution  is  uniform  over  the 
sensor  plane  then  we  can  segment  the  coupling  coefficients  to  obtain 

(8) 

j  -^s 

where  is  the  total  area  of  the  sensor  plane. 

In  conventional  multiplex  spectroscopy  the  input  field  is  single  mode  and  measurements  are  of 
the  form  .  Only  power  conservation  constraints  apply  to  coupling 

coefficient  in  these  systems,  i.e.  (v)  <  .  Multiplex  imaging  is  complicated  by  the 

following  factors: 

•  Source  data  is  encoded  both  in  the  mode  coefficients  Xj{v)  and  in  the  coupling 

coefficients  >^j(v).  In  conventional  systems  is  independent  of  the  source  state. 

The  relationship  between  the  modes  and  the  coupling  coefficients  in  multiplex  systems 
has  the  effect  of  making  sensing  more  difficult  and,  through  the  combination  the 

restriction  that  <  1  and  Eq.  (8),  limiting  the  power  on  individual  sensor  elements. 
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•  The  range  of  (v)  is  constrained  by  Eq.  (8).  In  conventional  multiplexing  P{y)  is  not 

strongly  coupled  to  detector  size  or  geometry.  As  expressed  in  Eq.  (8),  multiplexing  data 
from  more  than  one  mode  is  power  efficient  only  if  the  detector  size  grows  with  the 
number  of  modes  multiplexed.  Since  detector  noise  and  bandwidth  are  not  independent  of 
detector  size,  conventional  analyses  of  the  multiplex  advantage  do  not  necessarily  apply 
to  multiplex  imaging  systems. 

Multiplex  systems  may  be  subdivided  into  single  mode  spectrometers,  systems  in  which  the 
coherent  modes  are  known,  such  as  planar  hyperspectral  imagers,  and  systems  in  which  the 
coherent  modes  are  unknown,  such  as  multidimensional  spatio-spectral  sensors.  The  primary 
advantage  of  multiplexing  in  single  mode  systems  is  that  the  net  detected  power  is  greater  under 
multiplexing,  thereby  improving  photon  efficiency  and  SNR.  The  constant  radiance  theorem 
suggests  that  conventional  advantages  of  multiplex  sensing  are  less  persuasive  in  the  plane-to- 
plane  imaging  case  because  multiplexing  one  cannot  necessarily  increase  the  power  on 
individual  detector  elements  without  increasing  the  detector  area.  Depending  on  detector  size 
and  source  statistics,  however,  one  may  still  achieve  a  multiplexing  advantage  in  planar  imaging 
systems.  Comparison  of  potential  advantages  with  alternative  schemes,  such  as  adaptive  sensors, 
is  a  challenge  for  future  research.  Adaptive  filtering  to  discover  and  match  the  source  modes  is 
the  basis  of  adaptive  optical  telescopy.  Adaptive  optical  systems  correct  for  relatively  weak 
global  distortions  of  the  coherent  mode  structure.  Adaptive  filtering  for  strong  distortions  and 
general  partially  coherent  fields  has  not  yet  been  demonstrated.  One  might  also  consider  strategy 
of  combining  mode  powers  on  absorption  through  fluorescent  mode  reduction  strategies  to 
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address  the  constant  radiance  theorem.  Entropy  constraints  in  this  case  will  be  similar  to  those  in 
solar  power  collection  [13]. 

In  cases  where  the  coherent  modes  are  either  unknown  or  in  which  one  chooses  not  to  filter  on 
them  and  /^j(v)  are  unknown.  The  number  of  measurements  required  to  resolve  these 

variables  depends  on  the  extent  of  prior  knowledge.  In  most  cases  one  chooses  to  vary  the  optical 
system  to  generate  a  full  rank  linear  relationship  between  the  measurements  and  the  source  field. 
Examples  of  systems  that  can  measure  a  full  rank  transformation  include  direct  [9]  and  indirect 
[10]  coherence  measurement  systems.  How  well-conditioned  this  relationship  is  depends  both 
on  the  nature  of  the  source  and  of  the  set  of  optical  transformations  implemented.  The  selection 
of  optical  transformations  or  implementation  of  adaptive  systems  to  achieve  well-conditioned 
transformations  is  the  key  challenge  in  the  future  design  of  multiplex  imagers. 

This  work  was  supported  by  the  Defense  Research  Projects  Agency  through  AFOSR  grant 
number  F49620-00 1-1-0320. 
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